-- Logs begin at Wed 2022-08-17 15:19:06 UTC, end at Wed 2022-08-17 16:36:39 UTC. -- Aug 17 16:07:06.928089 dv-cinder-852208-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 16:07:06.936936 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 16:07:06 2022] *** Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: nodename: dv-cinder-852208-6-iscsi Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: machine: x86_64 Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: clock source: unix Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: pcre jit disabled Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: detected number of CPU cores: 4 Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: current working directory: / Aug 17 16:07:06.938892 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: detected binary path: /usr/bin/uwsgi-core Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: your processes number limit is 47680 Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: your memory page size is 4096 bytes Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: detected max file descriptor number: 2048 Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: lock engine: pthread robust mutexes Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: thunder lock: enabled Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 16:07:06.939579 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 16:07:06.979904 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: Python main interpreter initialized at 0x557b27bb89c0 Aug 17 16:07:06.979904 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: python threads support enabled Aug 17 16:07:06.979904 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: your server socket listen backlog is limited to 100 connections Aug 17 16:07:06.979904 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: your mercy for graceful operations on workers is 90 seconds Aug 17 16:07:06.980245 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 16:07:06.980333 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: *** Operational MODE: preforking *** Aug 17 16:07:06.980564 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: *** uWSGI is running in multiple interpreter mode *** Aug 17 16:07:06.980564 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: spawned uWSGI master process (pid: 105716) Aug 17 16:07:06.980760 dv-cinder-852208-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 16:07:06.981816 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: spawned uWSGI worker 1 (pid: 105717, cores: 1) Aug 17 16:07:06.981816 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: spawned uWSGI worker 2 (pid: 105718, cores: 1) Aug 17 16:07:06.981816 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 16:07:07.645135 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 16:07:07.645735 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 16:07:08.743387 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:07:08.743387 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: from cryptography.utils import int_from_bytes Aug 17 16:07:08.744157 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:07:08.744157 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: from cryptography.utils import int_from_bytes Aug 17 16:07:08.748005 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:07:08.748005 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: from cryptography.utils import int_from_bytes Aug 17 16:07:08.748430 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:07:08.748430 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: from cryptography.utils import int_from_bytes Aug 17 16:07:11.266003 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:07:11.266568 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:07:11.266772 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:07:11.267131 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:07:11.267386 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:07:11.267769 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.268121 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.268211 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:07:11.268560 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.268654 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:07:11.268744 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.268957 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:07:11.269048 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.269313 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:07:11.269418 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.269565 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:07:11.269654 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.269947 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270041 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270362 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270524 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270622 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270836 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.270923 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271157 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-6-iscsi {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271247 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271474 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271561 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271777 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.271897 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272112 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272212 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272424 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272519 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272676 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272770 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.272985 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273081 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273306 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-6-iscsi {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273394 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273622 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273802 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.273908 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.274969 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.275113 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.275223 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.275933 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276083 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276201 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276324 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276494 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276494 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.276882 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277008 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277008 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277258 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277401 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277536 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277671 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277802 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.277935 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278200 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-6-iscsi {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278325 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278448 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278571 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278694 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.278807 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279012 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279140 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279271 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279395 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279526 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279661 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279787 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.279930 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280174 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280338 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-6-iscsi {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280482 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280615 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280741 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.280867 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281017 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281145 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281333 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281468 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281651 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281788 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.281969 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282097 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282313 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282442 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282574 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282699 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282854 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.282984 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283172 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283300 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283474 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283611 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283783 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.283943 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284080 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284205 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284342 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284469 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284652 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284789 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.284970 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285100 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285292 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285433 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285560 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285693 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285818 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.285953 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286078 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286209 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286381 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286511 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286687 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286825 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.286993 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287122 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287300 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287428 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287563 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287689 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.287875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288006 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288141 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288267 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288422 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288554 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288726 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.288855 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289027 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289170 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289326 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289456 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289625 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289761 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.289925 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290063 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290222 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290354 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290509 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290684 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.290814 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.291557 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.291886 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.292030 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.292388 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.292528 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.292716 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.292855 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293026 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293155 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293345 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293474 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293667 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293796 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.293971 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294100 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294276 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294407 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294581 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294716 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.294900 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295037 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295200 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295330 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295512 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295649 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295775 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.295921 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296071 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296200 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296378 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296510 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296696 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.296825 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297000 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297136 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297306 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297446 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297611 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297744 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.297881 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298140 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298264 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298422 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298557 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298732 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.298874 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299033 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299170 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299330 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299461 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299629 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299768 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.299953 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300088 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300254 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300383 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300554 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300697 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300855 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.300992 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301152 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301280 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301449 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301580 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301745 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.301880 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302047 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302184 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302345 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302563 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302693 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302825 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.302950 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303074 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303237 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303376 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303536 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303678 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303851 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.303980 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304183 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304319 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304454 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304580 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304715 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.304842 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305015 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305153 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305313 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305451 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305626 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305756 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.305925 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306065 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306224 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306354 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306558 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306735 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.306873 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307106 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307243 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307424 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307554 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307738 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.307919 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308054 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308187 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308350 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308480 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308649 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308778 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.308947 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309078 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309244 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309383 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309542 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309672 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309841 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.309970 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310139 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310267 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310437 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310560 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310733 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.310863 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.311030 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.311168 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.311323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.311460 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.311634 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.311762 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.311959 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.312095 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.312259 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.312395 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.312546 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.312739 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.312868 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.313001 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.313136 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:07:11.313263 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.313450 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.313589 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.313775 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.313913 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314109 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314240 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314417 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314557 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314743 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.314881 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315211 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315381 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315508 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315686 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.315850 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316018 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316147 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316337 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316467 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316643 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316794 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.316932 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317065 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317245 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317374 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317557 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317688 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317869 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.317998 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318177 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318305 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318489 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318636 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318798 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.318928 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319109 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319240 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319414 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319546 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319725 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.319906 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320070 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320211 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320377 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320507 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320680 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.320809 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321000 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321143 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321329 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321459 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321632 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321759 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.321946 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.322083 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.322268 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.322420 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.322583 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.322845 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323043 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323193 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323319 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323482 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323620 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323840 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.323986 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324159 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324290 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324474 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324604 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324788 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.324936 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325105 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325244 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325417 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325564 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325722 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.325936 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326072 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326206 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326332 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326455 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326612 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326751 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.326917 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327054 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327226 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327355 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327529 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327668 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327855 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.327997 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328165 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328302 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328471 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328602 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328776 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.328907 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329076 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329213 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329373 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329504 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329672 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329801 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.329975 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330112 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330274 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330405 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330582 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330716 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.330894 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331025 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331192 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331321 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331513 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331648 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331839 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.331989 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332130 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332258 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332429 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332571 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332733 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.332890 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333086 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333225 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333352 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333476 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333622 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333760 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.333921 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334050 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334234 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334372 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334537 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334673 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334856 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.334985 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335169 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335299 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335481 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335612 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335785 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.335961 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336118 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336250 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336425 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336557 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336731 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.336868 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.337043 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.337178 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.337349 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.337480 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.337652 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.338274 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.338559 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.338746 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.338887 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339110 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339240 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339458 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339586 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339770 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.339945 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340099 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340236 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340405 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340544 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340707 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.340831 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341009 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341145 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341311 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341439 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341615 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341743 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.341915 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342046 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342215 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342351 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342515 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342646 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342813 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.342940 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343115 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343260 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343412 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343510 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343710 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.343823 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344031 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344143 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344327 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344423 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344642 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344728 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.344946 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345039 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345256 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345343 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345538 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345623 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345835 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.345933 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346170 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346256 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346469 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346562 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346803 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.346907 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347110 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347201 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347426 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347511 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347736 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.347853 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348065 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348149 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348374 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348461 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348678 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348764 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.348979 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349061 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349281 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349364 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349585 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349671 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349897 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.349982 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.350450 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.350548 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.350770 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.350874 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351072 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351159 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351387 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351480 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351689 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.351774 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352021 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352106 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352319 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352412 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352628 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352724 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.352943 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.353036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.353254 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.353348 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.354127 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.354270 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.354446 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.354767 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.354853 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355076 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355163 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355389 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355472 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355689 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.355772 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356020 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356107 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356329 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356415 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356636 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356729 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.356953 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357049 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357258 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357342 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357576 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357667 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357880 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.357972 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358187 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358271 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358489 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358580 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358790 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.358873 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359087 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359169 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359390 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359482 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359703 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.359788 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360133 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360342 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360427 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360643 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360726 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.360954 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361035 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361257 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361351 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361558 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361644 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361860 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.361945 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362158 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362243 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362462 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362556 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362771 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.362874 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363077 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363164 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363381 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363467 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363683 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.363780 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364003 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364087 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364312 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364405 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364613 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364711 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364911 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.364996 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365208 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365301 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365508 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365601 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365818 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.365907 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366122 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366206 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366435 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366528 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366745 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.366891 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367047 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367168 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367352 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367448 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367661 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367754 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.367996 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368091 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368295 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368396 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368594 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368687 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.368892 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369044 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369267 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369367 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369581 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369896 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.369981 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370206 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370300 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370518 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370611 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370835 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.370920 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371142 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371227 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371448 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371531 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371756 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.371886 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.372085 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.372171 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.372398 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.372529 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.372702 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373115 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373312 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373592 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373677 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373909 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.373994 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374214 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374300 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374529 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374614 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374832 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.374925 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375136 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375221 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375439 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375523 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375734 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.375845 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376063 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376149 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376375 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376470 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376746 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.376927 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377052 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377257 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377354 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377569 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377880 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.377978 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378194 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378280 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378506 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378599 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378819 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.378915 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379121 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379206 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379427 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379519 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379731 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.379857 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380060 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380154 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380358 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380446 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380657 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380751 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.380962 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381056 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381264 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381347 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381559 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381652 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381855 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.381947 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382158 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382244 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382454 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382547 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.382835 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383065 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383159 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383347 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383442 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383655 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383746 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.383973 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.384073 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.384279 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.384374 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.384574 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.384712 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385013 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385098 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385404 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385546 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385712 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.385861 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386017 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386166 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386324 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386470 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386634 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386811 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.386943 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387116 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387245 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387453 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387539 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387775 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.387889 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388134 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388233 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388437 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388522 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388735 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.388820 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389047 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389139 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389343 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389435 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389642 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389727 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.389942 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390035 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390242 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390325 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390543 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390633 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390843 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.390965 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391148 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391231 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391449 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391533 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391751 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.391856 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392075 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392174 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392369 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392465 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392672 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392757 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.392968 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393066 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393271 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393375 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393570 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393661 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393868 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.393954 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394166 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394265 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394470 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394563 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394771 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.394857 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395066 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395163 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395365 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395449 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395657 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395742 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.395988 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396085 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396285 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396370 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396582 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396677 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396879 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.396973 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397182 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397267 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397489 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397580 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397782 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.397867 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398088 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398173 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398390 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398482 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398694 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.398999 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399088 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399299 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399385 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399600 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399687 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.399922 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.400011 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.400716 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.400810 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401037 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401263 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401351 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401647 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401752 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.401950 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402073 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402253 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402379 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402553 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402689 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402891 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.402991 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403206 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403317 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403549 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403646 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403872 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.403962 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404173 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404471 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404558 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404770 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.404869 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405153 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405365 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405451 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405672 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405765 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.405974 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406059 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406273 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406366 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406571 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406658 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406867 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.406959 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407167 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407260 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407486 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407621 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407791 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.407901 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408123 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408221 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408442 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408529 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408754 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.408837 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409059 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409219 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409359 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409445 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409665 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409757 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.409962 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410059 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410265 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410356 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410566 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410651 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410870 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.410963 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411165 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411288 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411461 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411548 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411768 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.411904 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412094 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412178 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412398 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412485 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412699 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.412785 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413006 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413313 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413397 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413610 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413706 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413908 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.413993 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414211 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414295 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414597 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414810 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.414901 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415110 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415204 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415413 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415498 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415711 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.415795 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.416780 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.416897 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417140 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417321 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417451 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417626 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417755 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.417944 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418066 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418255 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418376 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418565 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418690 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.418870 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419002 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419192 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419307 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419499 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419722 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.419836 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420059 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420149 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420370 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420455 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420681 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420776 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.420984 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421069 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421282 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421405 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421596 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421805 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.421956 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422114 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422201 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422414 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422510 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422720 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.422805 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423025 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423110 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423343 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423491 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423708 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.423922 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424147 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424245 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424356 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424444 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424735 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.424819 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425042 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425151 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425353 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425461 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425655 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425769 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.425953 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426089 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426259 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426409 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426575 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426727 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.426875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427030 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427173 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427340 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427469 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427648 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427785 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.427996 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428108 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428319 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428423 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428628 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428831 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.428925 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429135 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429220 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429433 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429529 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429839 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.429924 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430145 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430246 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430451 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430536 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430768 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.430853 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431082 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431176 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431397 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431507 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431849 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.431957 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432178 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432338 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432478 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432653 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432782 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.432977 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433092 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433300 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433386 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433610 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433695 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.433922 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434017 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434224 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434312 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434542 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434636 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434860 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.434958 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435169 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435254 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435468 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435552 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435772 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.435904 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436116 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436210 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436419 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436505 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436739 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.436826 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437051 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437140 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437370 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437457 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437687 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437775 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.437989 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438074 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438286 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438370 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438585 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438672 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438887 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.438973 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439277 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439485 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439571 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439787 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.439931 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440115 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440213 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440411 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440497 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440709 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.440794 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441025 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441120 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441408 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441639 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441724 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.441948 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442035 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442263 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442355 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442577 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442664 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442876 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.442968 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443191 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443292 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443494 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443579 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443791 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.443974 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444114 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444208 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444411 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444498 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444718 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.444804 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445026 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445111 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445327 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445413 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445631 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445718 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.445932 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446017 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446246 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446342 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446546 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446639 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446866 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.446952 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.447699 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.447888 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448046 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448278 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448363 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448614 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448706 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.448916 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449003 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449218 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449303 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449524 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449662 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449825 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.449912 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450123 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450208 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450421 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450517 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450724 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.450809 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451020 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451105 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451317 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451412 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451614 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.451965 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452058 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452266 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452364 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452583 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452669 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452888 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.452974 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.453187 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.453282 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.453485 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.453571 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.453780 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454007 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454109 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454338 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454423 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454653 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454738 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.454969 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455062 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455280 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455365 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455592 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455686 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.455926 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456026 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456238 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456325 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456546 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456640 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456855 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.456943 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457162 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457247 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457470 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457555 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457774 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.457861 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458083 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458169 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458394 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458492 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458709 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.458796 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.459020 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.459224 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.459317 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.459629 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.459715 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460014 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460114 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460326 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460412 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460627 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460722 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.460935 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461020 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461243 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461328 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461550 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461637 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461857 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.461942 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.462163 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.462256 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.462469 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.462556 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.462829 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.463439 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.463656 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.463999 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464088 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464316 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464401 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464629 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464714 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.464959 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465048 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465291 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465377 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465608 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465700 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.465919 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466011 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466232 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466320 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466549 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466642 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.466856 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467066 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467152 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467382 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467479 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467711 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.467798 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468061 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468147 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468372 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468469 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468683 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468768 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.468988 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469079 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469293 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469388 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469596 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469681 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469899 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.469984 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470203 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470299 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470510 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470595 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470812 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.470897 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471217 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471435 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471527 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471735 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.471838 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472070 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472156 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472387 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472583 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472896 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.472980 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473221 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473308 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473539 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473625 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473857 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.473950 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474166 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474299 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474477 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474606 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474780 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.474878 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.475081 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.475166 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.475635 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.475723 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.475961 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476063 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476265 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476359 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476561 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476648 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476862 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.476956 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477164 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477248 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477459 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477552 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477766 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.477853 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.478065 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.478161 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.478398 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.478704 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.478799 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479033 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479241 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479331 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479561 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479656 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.479912 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480015 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480238 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480332 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480537 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480630 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480840 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.480928 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481146 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481239 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481447 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481541 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.481844 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482051 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482144 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482355 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482448 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482654 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482738 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.482954 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483253 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483346 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483555 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483640 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483877 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.483966 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484186 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484284 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484483 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484569 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484802 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.484895 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485104 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485198 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485404 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485489 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485701 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.485799 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486007 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486100 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486305 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486391 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486603 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486689 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486901 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.486988 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.487201 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.487469 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.487554 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.487791 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.487922 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488120 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488212 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488417 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488503 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488727 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.488856 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489024 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489111 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489328 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489414 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489626 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489713 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.489939 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490033 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490235 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490321 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490542 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490628 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490851 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.490938 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491159 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491247 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491468 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491556 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491771 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.491888 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492099 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492233 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492407 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492493 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492717 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.492811 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493024 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493246 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493333 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493574 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493660 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.493886 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494003 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494300 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494396 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494619 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494821 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.494961 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495119 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495280 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495421 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495598 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495721 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.495936 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496254 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496373 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496564 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496680 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496871 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.496986 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497181 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497291 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497488 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497597 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497801 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.497895 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498127 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498213 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498440 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498574 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498745 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.498835 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499072 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499158 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499376 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499462 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499680 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.499776 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500007 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500096 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500310 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500396 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500621 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500708 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.500953 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501039 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501265 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501363 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501574 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501660 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501882 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.501976 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502190 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502323 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502495 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502581 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502798 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.502893 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503102 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503196 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503404 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503491 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503713 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.503818 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504055 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504143 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504359 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504445 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504657 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504745 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.504973 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505273 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505359 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505574 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505661 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.505957 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506043 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506260 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506347 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506559 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506651 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506861 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.506947 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507164 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507251 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507470 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507569 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507769 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.507921 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508095 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508189 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508395 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508490 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508694 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508780 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.508994 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.509123 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.509293 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.509391 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.510089 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.510192 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.510407 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.510635 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.510731 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511176 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511395 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511480 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511697 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.511790 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512021 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512146 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512439 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512628 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512752 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.512927 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.513225 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.513523 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.513819 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514124 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514358 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514447 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514675 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514760 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.514982 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515079 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515277 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515363 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515571 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515663 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515893 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.515997 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516243 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516335 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516492 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516578 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516788 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.516890 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517081 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517168 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517377 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517464 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517670 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517764 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.517993 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518080 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518314 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518401 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518621 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518746 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.518933 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519030 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519240 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519333 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519546 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519633 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519870 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.519967 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520186 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520272 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520498 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520585 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520803 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.520890 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521105 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521199 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521428 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521514 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521729 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.521815 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522032 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522335 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522421 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522637 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522722 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.522940 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523079 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523242 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523329 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523550 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523642 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523873 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.523979 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524183 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524268 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524497 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524572 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524804 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.524881 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.525117 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.525192 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.525996 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.526284 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.526440 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.526638 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.526715 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.526985 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527061 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527300 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527378 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527611 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527687 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.527942 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528022 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528251 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528329 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528559 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528646 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528869 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.528963 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.529110 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:07:11.529187 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.529471 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.529781 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.530091 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.530409 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.530727 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.531031 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.531351 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.531671 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.532040 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.532351 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.532690 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.533011 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.533321 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.533629 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.533929 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:07:11.534165 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:07:11.682885 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Registered counter for database nova_api Aug 17 16:07:11.689091 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO dbcounter [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Registered counter for database nova_api Aug 17 16:07:11.705584 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.709374 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_db.sqlalchemy.engines [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.712194 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.716849 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writer thread running {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.769015 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.context [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37367ca3-7f41-4991-90e4-8af97b9dc4a0(cell1) {{(pid=105717) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 16:07:11.772588 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.context [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37367ca3-7f41-4991-90e4-8af97b9dc4a0(cell1) {{(pid=105718) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 16:07:11.772842 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:07:11.773311 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:07:11.774879 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:07:11.776213 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:07:11.776663 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:07:11.777251 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:07:11.777717 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:07:11.778638 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:07:11.779280 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:07:11.780036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:07:11.780479 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:07:11.780634 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Registered counter for database nova_cell0 Aug 17 16:07:11.782488 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_concurrency.lockutils [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:07:11.784594 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO dbcounter [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Registered counter for database nova_cell0 Aug 17 16:07:11.786043 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Registered counter for database nova_cell1 Aug 17 16:07:11.790087 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO dbcounter [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Registered counter for database nova_cell1 Aug 17 16:07:11.793566 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.795839 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.797292 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_db.sqlalchemy.engines [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.801046 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.802498 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writer thread running {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.803952 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.806923 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_db.sqlalchemy.engines [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.943711 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writer thread running {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.946763 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Registered counter for database nova_cell0 Aug 17 16:07:11.953169 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO dbcounter [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Registered counter for database nova_cell0 Aug 17 16:07:11.956258 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.960639 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:11.961742 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG oslo_db.sqlalchemy.engines [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:07:11.966454 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writer thread running {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:07:12.301141 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:07:12.304417 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: WARNING keystonemiddleware.auth_token [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:07:12.308680 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:07:12.311640 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: WARNING keystonemiddleware.auth_token [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:07:12.653618 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:07:12.659619 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:07:12.660556 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: WARNING keystonemiddleware.auth_token [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:07:12.664912 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b27bb89c0 pid: 105717 (default app) Aug 17 16:07:12.666671 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: WARNING keystonemiddleware.auth_token [None req-f7703039-1d98-46dc-a4ea-d542c3dd8de3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:07:12.667003 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:07:12.668218 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Aug 17 16:07:12.668625 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Aug 17 16:07:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:07:12.671908 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b27bb89c0 pid: 105718 (default app) Aug 17 16:08:31.180172 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:31.181177 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 17 16:08:31.186677 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:31.195053 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_api:SELECT=3 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:31.196450 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_cell0:SELECT=3 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:31.197501 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_cell1:SELECT=3 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:31.198828 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:32.084614 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-4d4665c2-81a7-4511-80e0-7a83882ed6ca admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:32.117700 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-4d4665c2-81a7-4511-80e0-7a83882ed6ca admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928910 Aug 17 16:08:32.118552 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 17 16:08:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:08:34.468426 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:34.469571 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7ff5dadf-234d-4f6c-878d-6189b1d2b76d None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 17 16:08:34.470067 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:34.931623 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-b8b3850e-f390-45fa-8a0b-e9a08a5595a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:34.951857 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:08:34.951857 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: warnings.warn(msg) Aug 17 16:08:34.981403 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-b8b3850e-f390-45fa-8a0b-e9a08a5595a4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504548 Aug 17 16:08:34.982021 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:08:34.996651 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:34.997736 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell1:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:34.999044 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:35.000046 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:35.217800 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-8c062ac2-274d-4b34-8885-3757270bd41c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:35.222666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:08:35.222666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:08:35.285447 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-8c062ac2-274d-4b34-8885-3757270bd41c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294596 Aug 17 16:08:35.286686 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 17 16:08:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:08:37.658227 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-b8b3850e-f390-45fa-8a0b-e9a08a5595a4 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:37.659250 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-b8b3850e-f390-45fa-8a0b-e9a08a5595a4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 17 16:08:37.659651 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:38.335889 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a8a34c3c-81e5-42b7-9dd1-94643c5fac5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:38.355325 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:08:38.355325 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:08:38.377784 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a8a34c3c-81e5-42b7-9dd1-94643c5fac5d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711459 Aug 17 16:08:38.378555 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:08:38.392287 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-cdd1efdc-898f-4e17-bc85-dc3d7192b046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:38.395272 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:08:38.395272 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: warnings.warn(msg) Aug 17 16:08:38.430644 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-cdd1efdc-898f-4e17-bc85-dc3d7192b046 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042780 Aug 17 16:08:38.431220 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 17 16:08:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:08:40.810835 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a8a34c3c-81e5-42b7-9dd1-94643c5fac5d admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:40.811934 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a8a34c3c-81e5-42b7-9dd1-94643c5fac5d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 17 16:08:40.812343 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:41.218685 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-3f342657-4016-4ca4-8929-9b54d0fe5cf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "id": "d2", "swap": 0, "disk": 10}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:41.237672 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-3f342657-4016-4ca4-8929-9b54d0fe5cf4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419122 Aug 17 16:08:41.238309 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:08:41.250574 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-55a2d5bc-01f6-4e2b-a8f1-a4bb9b9b0e9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:41.275422 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-55a2d5bc-01f6-4e2b-a8f1-a4bb9b9b0e9a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028405 Aug 17 16:08:41.276169 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 17 16:08:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:08:43.650007 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-3f342657-4016-4ca4-8929-9b54d0fe5cf4 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:43.651020 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-3f342657-4016-4ca4-8929-9b54d0fe5cf4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 17 16:08:43.651425 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:44.136834 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-b4492cb0-a6fe-4eee-8e30-f35cbdbb71e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:44.158131 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-b4492cb0-a6fe-4eee-8e30-f35cbdbb71e5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500761 Aug 17 16:08:44.158784 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:08:44.170675 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-474221e9-d319-4ae9-81bf-2ea90d7ae3fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:44.196986 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-474221e9-d319-4ae9-81bf-2ea90d7ae3fd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029778 Aug 17 16:08:44.197484 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 17 16:08:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:08:46.596717 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-b4492cb0-a6fe-4eee-8e30-f35cbdbb71e5 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:46.598423 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-b4492cb0-a6fe-4eee-8e30-f35cbdbb71e5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Aug 17 16:08:46.599207 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:47.051585 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:47.076246 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470248 Aug 17 16:08:47.079852 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:08:47.089671 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-87e6ade0-056f-4dc8-9997-8eb42b866346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:47.115064 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-87e6ade0-056f-4dc8-9997-8eb42b866346 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028944 Aug 17 16:08:47.115634 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 17 16:08:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:08:49.693572 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:49.695650 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Aug 17 16:08:49.696247 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:50.146847 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a91d8565-d757-4841-b946-fb103653ab3e admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:50.172777 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a91d8565-d757-4841-b946-fb103653ab3e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468980 Aug 17 16:08:50.173321 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 17 16:08:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:08:52.697069 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:52.698543 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-6e3d4795-698b-498a-b06f-daee484b7f43 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 17 16:08:52.699200 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:53.147590 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-fed5ac58-65ab-491e-830c-9c7f47b5ff20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:53.167969 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-fed5ac58-65ab-491e-830c-9c7f47b5ff20 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.462580 Aug 17 16:08:53.168513 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:08:53.181474 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-7531394c-a9a5-4a6b-b430-e2b9f8e9f1da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:53.206661 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-7531394c-a9a5-4a6b-b430-e2b9f8e9f1da admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029431 Aug 17 16:08:53.207219 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 17 16:08:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:08:55.581750 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-fed5ac58-65ab-491e-830c-9c7f47b5ff20 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:55.582748 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-fed5ac58-65ab-491e-830c-9c7f47b5ff20 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 17 16:08:55.583147 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:08:55.990547 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-092f7b45-0f08-45ae-8327-b092f43ecfdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:56.009641 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-092f7b45-0f08-45ae-8327-b092f43ecfdc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419796 Aug 17 16:08:56.010499 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:08:56.022461 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-92c49100-2cdc-4003-a768-01989a432273 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:56.047593 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-92c49100-2cdc-4003-a768-01989a432273 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028795 Aug 17 16:08:56.048528 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 17 16:08:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:08:58.446304 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-092f7b45-0f08-45ae-8327-b092f43ecfdc admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:08:58.447318 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-092f7b45-0f08-45ae-8327-b092f43ecfdc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 17 16:08:58.447726 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:08:58.904963 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a6b322a6-a9ce-46a8-849d-0f2042597484 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:58.924751 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a6b322a6-a9ce-46a8-849d-0f2042597484 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470948 Aug 17 16:08:58.925294 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:08:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:08:58.938639 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f32883f5-29a3-44c0-bd00-57fdc4bc311a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:08:58.964308 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f32883f5-29a3-44c0-bd00-57fdc4bc311a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029907 Aug 17 16:08:58.965225 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 17 16:08:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:09:01.373975 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a6b322a6-a9ce-46a8-849d-0f2042597484 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:01.392181 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a6b322a6-a9ce-46a8-849d-0f2042597484 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.012567 Aug 17 16:09:01.395737 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:01.877882 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-1dc75f77-a763-4660-b9d5-43323bb8e503 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "swap": 0}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:01.885155 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:01.907912 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-1dc75f77-a763-4660-b9d5-43323bb8e503 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.504121 Aug 17 16:09:01.908657 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:09:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:09:01.920460 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-dbbcfe6f-470f-4c90-82f9-d2ec3569061e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:01.946432 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-dbbcfe6f-470f-4c90-82f9-d2ec3569061e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029553 Aug 17 16:09:01.955911 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 17 16:09:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:09:04.325064 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-1dc75f77-a763-4660-b9d5-43323bb8e503 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:04.326071 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-1dc75f77-a763-4660-b9d5-43323bb8e503 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 16:09:04.326656 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:09:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:04.763867 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:04.783777 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.451043 Aug 17 16:09:04.784353 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 17 16:09:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:04.796532 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-5bc589f5-c35d-4203-8547-0dd3e1a47af2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:04.829787 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-5bc589f5-c35d-4203-8547-0dd3e1a47af2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036845 Aug 17 16:09:04.830602 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 17 16:09:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:09:23.777022 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:23.778028 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 17 16:09:23.778425 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:23.789351 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:24.170067 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-53d86613-4e9d-48d2-aa1c-dc3d5c639b9b admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:24.188484 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-53d86613-4e9d-48d2-aa1c-dc3d5c639b9b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403854 Aug 17 16:09:24.189004 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 17 16:09:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:09:25.250213 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:25.251481 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-f021f55a-ad54-4784-a70a-644d136a37e2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Aug 17 16:09:25.251888 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:25.775963 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-1cef514d-080d-446a-bc50-5343e3a76dc6 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:25.781487 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.wsgi [None req-1cef514d-080d-446a-bc50-5343e3a76dc6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-1cef514d-080d-446a-bc50-5343e3a76dc6 admin admin] Request method failure captured: Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept: application/json Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept-Encoding: gzip, deflate Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Connection: keep-alive Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Content-Length: 0 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Host: 10.222.0.60 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-System-Scope: None Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: User-Agent: python-novaclient Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Auth-Token: gAAAAABi_RK17COehhlanH3qQhXvLAJMasK1b5JUscoDXYIaT6MfZbtYdaMU_lcs6YS19FoTHkLb3A79CBlSRBe2wVED_MX-u_m4BtIQYp-e9WErbxaXe_ukYtTjxAzkGdd2duYHgr16fI6FtsHpVKhm5Vcec6C_L0OG5uDcxBySYJjOeYxS1LA Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Id: None Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Name: None Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Identity-Status: Confirmed Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Is-Admin-Project: True Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Id: default Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Name: Default Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Name: admin Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Role: member,admin,reader Aug 17 16:09:25.784750 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Roles: member,admin,reader Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant: admin Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Name: admin Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User: admin Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Id: default Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Name: Default Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Name: admin Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: method: > Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: exception: Flavor 42 could not be found. Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: action_args: {'id': '42'} Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:25.786340 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:25.788009 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.789323 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-1cef514d-080d-446a-bc50-5343e3a76dc6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:25.790543 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-1cef514d-080d-446a-bc50-5343e3a76dc6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395946 Aug 17 16:09:25.790543 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 17 16:09:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:25.796022 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-97e7d08c-26f5-4bff-88d7-1a6306e8eace admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:25.800188 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:25.821326 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-97e7d08c-26f5-4bff-88d7-1a6306e8eace admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028872 Aug 17 16:09:25.821861 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:09:25.831628 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-6f97e45e-2f9d-4f6d-86d6-7d5ee79dc7b7 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:25.856385 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-6f97e45e-2f9d-4f6d-86d6-7d5ee79dc7b7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028253 Aug 17 16:09:25.857224 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:09:25.867536 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6b079969-3987-45ff-a415-e992ca9108f8 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:25.873264 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-6b079969-3987-45ff-a415-e992ca9108f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6b079969-3987-45ff-a415-e992ca9108f8 admin admin] Request method failure captured: Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Host: 10.222.0.60 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABi_RK17COehhlanH3qQhXvLAJMasK1b5JUscoDXYIaT6MfZbtYdaMU_lcs6YS19FoTHkLb3A79CBlSRBe2wVED_MX-u_m4BtIQYp-e9WErbxaXe_ukYtTjxAzkGdd2duYHgr16fI6FtsHpVKhm5Vcec6C_L0OG5uDcxBySYJjOeYxS1LA Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Role: member,admin,reader Aug 17 16:09:25.876511 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Roles: member,admin,reader Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User: admin Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: method: > Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: exception: Flavor 42 could not be found. Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: action_args: {'id': '42'} Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:25.878038 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:25.879018 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:25.880130 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6b079969-3987-45ff-a415-e992ca9108f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:25.881679 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-6b079969-3987-45ff-a415-e992ca9108f8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014666 Aug 17 16:09:25.881679 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 17 16:09:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:26.850292 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-6f97e45e-2f9d-4f6d-86d6-7d5ee79dc7b7 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:26.852360 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-6f97e45e-2f9d-4f6d-86d6-7d5ee79dc7b7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002781 Aug 17 16:09:26.852838 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:27.381833 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-be1a649e-a257-46b8-82b8-b9d07ac9ef61 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:27.387112 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-be1a649e-a257-46b8-82b8-b9d07ac9ef61 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-be1a649e-a257-46b8-82b8-b9d07ac9ef61 admin admin] Request method failure captured: Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Host: 10.222.0.60 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABi_RK2LfE62lM7Jhy27JiQ2pS0mGz-R_yJqzzMThd1hVNxeEf3hM8_zcdowQdymDXTRr-1T9gRdIGa5FNg_wFEBz6X7xo7RT4btkzcAhmKkLbrIEdMNdH7Fr7b1bxEHxpOzcGhTbK2X0f7MhHnVWaB49-ld2OcDkZCgst5vc0P1LNfDyY Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Role: member,admin,reader Aug 17 16:09:27.388642 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Roles: member,admin,reader Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User: admin Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: method: > Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: exception: Flavor 84 could not be found. Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: action_args: {'id': '84'} Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:27.390205 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:27.391266 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.392701 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-be1a649e-a257-46b8-82b8-b9d07ac9ef61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:27.393938 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-be1a649e-a257-46b8-82b8-b9d07ac9ef61 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396601 Aug 17 16:09:27.393938 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 17 16:09:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:27.399914 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-167b4ff0-535c-499f-bd91-7936565d1bf6 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:27.415490 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-167b4ff0-535c-499f-bd91-7936565d1bf6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019347 Aug 17 16:09:27.416048 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:09:27.425306 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-66d4e0f9-4548-402e-b7c0-1ae22a65bbb2 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:27.440664 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-66d4e0f9-4548-402e-b7c0-1ae22a65bbb2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018835 Aug 17 16:09:27.441181 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:09:27.450207 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-8ca2b0df-5cb0-4dd0-992b-ecca4c48f415 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:27.455364 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.wsgi [None req-8ca2b0df-5cb0-4dd0-992b-ecca4c48f415 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-8ca2b0df-5cb0-4dd0-992b-ecca4c48f415 admin admin] Request method failure captured: Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept: application/json Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept-Encoding: gzip, deflate Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Connection: keep-alive Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Content-Length: 0 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Host: 10.222.0.60 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-System-Scope: None Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: User-Agent: python-novaclient Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Auth-Token: gAAAAABi_RK2LfE62lM7Jhy27JiQ2pS0mGz-R_yJqzzMThd1hVNxeEf3hM8_zcdowQdymDXTRr-1T9gRdIGa5FNg_wFEBz6X7xo7RT4btkzcAhmKkLbrIEdMNdH7Fr7b1bxEHxpOzcGhTbK2X0f7MhHnVWaB49-ld2OcDkZCgst5vc0P1LNfDyY Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Id: None Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Name: None Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Identity-Status: Confirmed Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Is-Admin-Project: True Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Id: default Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Name: Default Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Name: admin Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Role: member,admin,reader Aug 17 16:09:27.456875 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Roles: member,admin,reader Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant: admin Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Name: admin Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User: admin Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Id: default Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Name: Default Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Name: admin Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: method: > Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: exception: Flavor 84 could not be found. Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: action_args: {'id': '84'} Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:27.458185 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:27.459036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:27.460997 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-8ca2b0df-5cb0-4dd0-992b-ecca4c48f415 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:27.462298 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-8ca2b0df-5cb0-4dd0-992b-ecca4c48f415 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011566 Aug 17 16:09:27.462298 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 17 16:09:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 16:09:28.434575 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-66d4e0f9-4548-402e-b7c0-1ae22a65bbb2 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:28.435586 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-66d4e0f9-4548-402e-b7c0-1ae22a65bbb2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 17 16:09:28.436010 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:28.964461 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f8685ea5-d5e3-4094-a8f4-c6659bd47d6a admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:28.970120 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.wsgi [None req-f8685ea5-d5e3-4094-a8f4-c6659bd47d6a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f8685ea5-d5e3-4094-a8f4-c6659bd47d6a admin admin] Request method failure captured: Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept: application/json Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Accept-Encoding: gzip, deflate Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Connection: keep-alive Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Content-Length: 0 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Host: 10.222.0.60 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Openstack-System-Scope: None Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: User-Agent: python-novaclient Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Auth-Token: gAAAAABi_RK4HfdPmtzH_K3AalpfoqsTea33JuZoTTa-4gmHW9GWub9Oiv2gtGAmAIcg8wHTLi7ONKWey8iHaljPKUbS_5AlIIGBnAukkUwcHtkRB1ZnPDidErJy5rhOhcv9Ps3d2ADTSy_ZJChOJXTlga8G-hZOAkA-iLut8BdIL_yJGX2kPC0 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Id: None Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Domain-Name: None Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Identity-Status: Confirmed Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Is-Admin-Project: True Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Id: default Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Domain-Name: Default Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Project-Name: admin Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Role: member,admin,reader Aug 17 16:09:28.971591 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Roles: member,admin,reader Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant: admin Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-Tenant-Name: admin Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User: admin Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Id: default Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Domain-Name: Default Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: X-User-Name: admin Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: method: > Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: exception: Flavor 451 could not be found. Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: action_args: {'id': '451'} Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:28.973199 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:28.974090 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: ERROR nova.api.openstack.wsgi Aug 17 16:09:28.975972 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f8685ea5-d5e3-4094-a8f4-c6659bd47d6a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:28.977036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f8685ea5-d5e3-4094-a8f4-c6659bd47d6a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395963 Aug 17 16:09:28.977036 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:09:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:28.983579 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-444cbfc9-30e7-420b-94ab-7da4a141171f admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:28.998929 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-444cbfc9-30e7-420b-94ab-7da4a141171f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018960 Aug 17 16:09:28.999436 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:09:29.008807 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:29.023620 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018488 Aug 17 16:09:29.024158 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 17 16:09:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:09:29.033017 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a62eb8ea-0e10-4f82-8db9-d4aee5624e42 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:29.039139 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-a62eb8ea-0e10-4f82-8db9-d4aee5624e42 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a62eb8ea-0e10-4f82-8db9-d4aee5624e42 admin admin] Request method failure captured: Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Host: 10.222.0.60 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABi_RK4HfdPmtzH_K3AalpfoqsTea33JuZoTTa-4gmHW9GWub9Oiv2gtGAmAIcg8wHTLi7ONKWey8iHaljPKUbS_5AlIIGBnAukkUwcHtkRB1ZnPDidErJy5rhOhcv9Ps3d2ADTSy_ZJChOJXTlga8G-hZOAkA-iLut8BdIL_yJGX2kPC0 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Role: member,admin,reader Aug 17 16:09:29.041014 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Roles: member,admin,reader Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8e2e0137191a4168b0b70f0ebaa36507", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8e2e0137191a4168b0b70f0ebaa36507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Id: 8e2e0137191a4168b0b70f0ebaa36507 Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User: admin Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Id: 7d6febb46d1d4d2ea74959cb655ad9f0 Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: method: > Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: exception: Flavor 451 could not be found. Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: action_args: {'id': '451'} Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:09:29.042655 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:29.043666 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 17 16:09:29.044983 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a62eb8ea-0e10-4f82-8db9-d4aee5624e42 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:09:29.046307 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a62eb8ea-0e10-4f82-8db9-d4aee5624e42 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012754 Aug 17 16:09:29.046307 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:09:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:30.015695 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:30.016714 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 17 16:09:30.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:30.541258 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-75ee36c9-493e-42fd-8bd7-f255fbb9f05b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:30.560818 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-75ee36c9-493e-42fd-8bd7-f255fbb9f05b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407132 Aug 17 16:09:30.561354 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 17 16:09:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:31.545139 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:31.546138 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 17 16:09:31.546533 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:32.072926 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a07ef657-3ee6-4270-aec4-d6ff5710005c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:32.091536 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a07ef657-3ee6-4270-aec4-d6ff5710005c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.407208 Aug 17 16:09:32.092046 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 17 16:09:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:33.061395 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:33.062430 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 17 16:09:33.062823 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:33.590951 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-ada32cc0-625f-41bf-9a14-c1fc5f5438ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:33.610101 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-ada32cc0-625f-41bf-9a14-c1fc5f5438ac admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407299 Aug 17 16:09:33.610672 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 17 16:09:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:34.597513 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:34.598515 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 16:09:34.598912 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:35.125086 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-10d9a4e0-4da0-4f6e-a7ee-0a95650b658c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:09:35.143037 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-10d9a4e0-4da0-4f6e-a7ee-0a95650b658c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402809 Aug 17 16:09:35.143581 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 17 16:09:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:09:36.116403 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:36.117434 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 17 16:09:36.117827 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:09:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:09:36.672767 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-3ceb5b7b-c88d-40b7-a21c-3f8b14a62f21 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:09:36.692813 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-3ceb5b7b-c88d-40b7-a21c-3f8b14a62f21 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.431246 Aug 17 16:09:36.693482 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Aug 17 16:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:10:30.152803 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.153805 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-ed1dae7e-c4b3-49bc-9ec6-71954ef7cb6c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 17 16:10:30.154196 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:10:30.165383 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:30.556167 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-bd40fdca-7219-4057-86f9-96bba72d571b admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.576807 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-bd40fdca-7219-4057-86f9-96bba72d571b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416596 Aug 17 16:10:30.577338 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:10:30.600173 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG dbcounter [-] [105718] Writing DB stats nova_api:SELECT=14 {{(pid=105718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:30.604303 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-3f8f8a1b-82c9-4d35-8a26-2c41c790dc74 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.611889 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-3f8f8a1b-82c9-4d35-8a26-2c41c790dc74 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013800 Aug 17 16:10:30.612403 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:10:30.625127 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-3461da25-10aa-432e-99e7-50e05a352eae admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.637934 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-3461da25-10aa-432e-99e7-50e05a352eae admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016419 Aug 17 16:10:30.638478 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:10:30.650134 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.657760 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011158 Aug 17 16:10:30.658212 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:10:30.669614 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-d586e442-619f-41f2-a293-62414657dca7 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:10:30.677765 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-d586e442-619f-41f2-a293-62414657dca7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011654 Aug 17 16:10:30.678271 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 17 16:10:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:13:27.454131 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:27.455141 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 17 16:13:27.455565 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:13:27.597127 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=6 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:27.755854 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:27.758141 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:13:27.758141 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:13:27.759278 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:27.759745 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:27.760213 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:27.760913 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:27.761349 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:27.761784 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:27.795640 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a0529e8d-f664-4fd0-a571-d8ff6b22262d admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200284 Aug 17 16:13:27.796237 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:13:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:13:28.634288 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:28.635290 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 17 16:13:28.635685 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:13:28.828411 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:28.831587 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:13:28.831587 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:13:28.832735 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:28.833212 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:28.833640 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:28.834348 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:28.834790 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:28.835202 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:28.854950 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-44411e2d-cf4f-4cc4-8449-f953965b82dd admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078709 Aug 17 16:13:28.855517 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:13:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:13:40.095834 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:40.097070 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Aug 17 16:13:40.097471 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:13:40.241928 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:40.242638 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell1:SELECT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:40.243269 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=8 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:40.291086 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:40.293450 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:13:40.293450 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:13:40.294568 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:40.295034 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:40.295488 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:40.296214 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:40.296651 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:40.297070 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:40.321894 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7ea3672f-ef98-4f0b-86c4-aac1c2a55ecc admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085428 Aug 17 16:13:40.322433 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:13:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:13:41.169432 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: DEBUG nova.api.openstack.wsgi [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] Calling method '>' {{(pid=105718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:41.170435 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: INFO nova.api.openstack.requestlog [None req-f89fe73e-dad8-4fca-82ba-65aecd53bec9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Aug 17 16:13:41.170827 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: [pid: 105718|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 17 16:13:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:13:41.361991 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:13:41.364523 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:13:41.364523 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 17 16:13:41.365623 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:41.366119 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:41.366544 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:41.367281 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:13:41.367720 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:13:41.368157 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:13:41.389845 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-0798d385-1717-4e04-bd84-b750fd29935c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080663 Aug 17 16:13:41.390333 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 17 16:13:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:14:40.639533 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: Wed Aug 17 16:14:40 2022 - graceful shutdown triggered... Aug 17 16:14:40.639654 dv-cinder-852208-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 16:14:40.640527 dv-cinder-852208-6-iscsi devstack@n-api.service[105718]: Gracefully killing worker 2 (pid: 105718)... Aug 17 16:14:40.640900 dv-cinder-852208-6-iscsi devstack@n-api.service[105717]: Gracefully killing worker 1 (pid: 105717)... Aug 17 16:14:41.640680 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: worker 1 buried after 1 seconds Aug 17 16:14:41.641218 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: worker 2 buried after 1 seconds Aug 17 16:14:41.641218 dv-cinder-852208-6-iscsi devstack@n-api.service[105716]: goodbye to uWSGI. Aug 17 16:14:41.642240 dv-cinder-852208-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 16:14:41.642784 dv-cinder-852208-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 16:14:41.645811 dv-cinder-852208-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 16:14:41.655615 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 16:14:41 2022] *** Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: nodename: dv-cinder-852208-6-iscsi Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: machine: x86_64 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: clock source: unix Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: pcre jit disabled Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: detected number of CPU cores: 4 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: current working directory: / Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: detected binary path: /usr/bin/uwsgi-core Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: your processes number limit is 47680 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: your memory page size is 4096 bytes Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: detected max file descriptor number: 2048 Aug 17 16:14:41.657636 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: lock engine: pthread robust mutexes Aug 17 16:14:41.658494 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: thunder lock: enabled Aug 17 16:14:41.658494 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 16:14:41.658494 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 16:14:41.700660 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: Python main interpreter initialized at 0x55b8439079c0 Aug 17 16:14:41.700660 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: python threads support enabled Aug 17 16:14:41.700660 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: your server socket listen backlog is limited to 100 connections Aug 17 16:14:41.700660 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: your mercy for graceful operations on workers is 90 seconds Aug 17 16:14:41.701124 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 16:14:41.701124 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: *** Operational MODE: preforking *** Aug 17 16:14:41.701395 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: *** uWSGI is running in multiple interpreter mode *** Aug 17 16:14:41.701395 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: spawned uWSGI master process (pid: 120775) Aug 17 16:14:41.701608 dv-cinder-852208-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 16:14:41.702459 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: spawned uWSGI worker 1 (pid: 120793, cores: 1) Aug 17 16:14:41.702459 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: spawned uWSGI worker 2 (pid: 120794, cores: 1) Aug 17 16:14:41.702459 dv-cinder-852208-6-iscsi devstack@n-api.service[120775]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 16:14:42.366364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 16:14:42.367323 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 16:14:43.531759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:14:43.531759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: from cryptography.utils import int_from_bytes Aug 17 16:14:43.532769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:14:43.532769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: from cryptography.utils import int_from_bytes Aug 17 16:14:43.535936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:14:43.535936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: from cryptography.utils import int_from_bytes Aug 17 16:14:43.536600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:14:43.536600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: from cryptography.utils import int_from_bytes Aug 17 16:14:45.862712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:14:45.863205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:14:45.863498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:14:45.863885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:14:45.864148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:14:45.864539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.864868 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.865194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.865515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.865861 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.866180 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.866709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.867039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.867383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.867646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.867988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.868509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-6-iscsi {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.868840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.869157 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.869484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.869807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.870131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.870459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.870857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.871283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.871731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.872073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.872390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.872740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.873051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.873364 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.873688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.873998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.874325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.874639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.875044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-6-iscsi {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.875365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.875696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.876041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.876480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.876780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.877092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.877416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.878312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.878630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.878969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.879293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.879615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.880034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.880340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.880653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.880965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.881288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.881596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.881904 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.882156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.882468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.882790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.883115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.883438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.883694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.883968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.884290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.884611 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.884923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.885232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.885541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.885848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.886165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.886473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.886783 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.887090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.887409 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.887727 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.888076 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.888390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.888714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.889109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.889361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.889669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.890008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.890324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.890635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.890956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.891290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.891583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.891913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.892223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.892541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.892875 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.893197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.894014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.894295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.894613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.894925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.895233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.895557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.895886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.896197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.896329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:14:45.896790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.896916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:14:45.897030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.897142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:14:45.897252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.897377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:14:45.897496 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.897617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:14:45.897731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.897970 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.898090 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.898277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.898418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.898585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.899870 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.900923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901132 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901861 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.901951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902212 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-6-iscsi {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902860 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.902956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903383 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903559 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903642 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.903731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.904087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.904279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.904391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905085 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905282 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.905946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906294 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906657 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.906944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-6-iscsi {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.907960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908256 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.908907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.909145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.909454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.909557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.909786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.910019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.910124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.910430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.910530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.910741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.910846 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.911079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.911185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.911397 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.911490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.911711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.911878 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.912056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.912158 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.912358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.912461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.912664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.912765 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.912969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.913078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.913279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.913372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.913579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.913680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.913882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.913977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.914168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.914275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.914430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.914524 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.914746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.914841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.915062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.915164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.915382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.915494 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.915633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.915734 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.915902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.916065 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.916217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.916393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.916534 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.916704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.916838 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.917047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.917151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.917399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.917529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.917717 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.917832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.918017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.918135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.918317 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.918420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.918618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.918732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.918920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.919037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.919231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.919340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.919542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.919654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.919880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.919998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.920186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.920287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.920498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.920603 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.920818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.920919 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.921122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.921255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.921424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.921518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.921736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.921837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.922050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.922155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.922354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.922471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.922668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.922786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.922983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.923093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.923290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.923384 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.923589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.923691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.923917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.924015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.924233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.924345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.924582 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.924692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.925057 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.925150 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.925373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.925481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.925683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.925777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.926001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.926110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.926316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.926424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.926621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.926721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.926927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.927027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.927231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.927342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.927529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.927630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.927849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.927954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.928156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.928271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.928457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.928558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.928759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.928860 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.929061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.929163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.929361 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.929452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.929665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.929904 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.930066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.930162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.930867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.930975 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.931051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.931130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.931203 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.931305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.931389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.931461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.931558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.931638 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.931709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.931828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.932034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.932348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.932532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.932688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.932843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.932988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.933150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.933302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.933460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.933619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.933777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.933930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.934074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.934224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.934468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.934619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.934771 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.934923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.935077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.935233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.935233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.935520 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.935672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.935858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.936065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.936225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.936377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.936520 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.936663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.936810 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.936956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.937123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.937272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.937428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.937567 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.937710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.937851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.938001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.938149 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.938287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.938430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.938571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.938719 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.938866 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.939013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.939149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.939297 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.939437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.939590 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.939744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.939916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.940568 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.940687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.940830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.940986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:14:45.941096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.941297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.941394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.941621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.941777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.941925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.942077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.942653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.942811 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.942974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.943936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944344 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.944999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945484 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.945897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.946121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.946341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.946533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.946721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.946915 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.947955 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.948211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.948367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.948552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.948726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.948876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949155 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.949865 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950113 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950219 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.950965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951590 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.951933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952463 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.952888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953087 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.953809 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954121 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.954956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.955050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.955269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.955371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.955577 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.955725 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.956492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.956650 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.956806 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.957844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958046 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958762 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.958968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959069 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959380 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959582 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.959911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960631 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.960918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.961836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.962977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.963921 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.964981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965439 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.965883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.966936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967085 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967234 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.967998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.968945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.969994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970328 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.970908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.971060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.971208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.971379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.971864 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972347 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972347 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.972960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.973215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.973402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.973982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974296 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974770 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.974925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.975077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.975230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.975383 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.975535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976782 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.976937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.977989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.978875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979601 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.979950 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980257 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980409 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.980874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981773 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.981920 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.982904 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.983942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.984886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985811 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.985950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986125 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.986926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.987098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.987470 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.987597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.987938 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.988091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.988247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.988559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.988652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.988868 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989803 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.989911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.990866 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991146 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991314 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.991968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992715 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.992864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993300 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.993903 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994642 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.994952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995699 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.995879 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996500 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996811 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.996969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997567 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.997876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998382 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.998991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999281 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999720 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:45.999916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000069 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.000973 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.001953 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.002154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.002274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.002460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.003102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.003351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.003467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.003722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.004020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.004343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.004664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.004964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.005248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.005345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.005585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.005680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.005905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.006958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.007175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.007270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.007629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.008939 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009506 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.009987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.010967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.011068 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.011270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.011365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.011572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.011695 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012632 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.012838 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013063 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.013867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014076 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014235 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.014996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.015099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.015299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.015509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.015645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.015976 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016085 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.016920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017624 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.017958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.018173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.019108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.019253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.019640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.019753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.020959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.021234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.021371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.021560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.021729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.021874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.022159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.022301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.022458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.022766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.022924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.023066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.023299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.023434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.023647 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.023787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.024905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.025189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.025336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.025476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.025780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.025921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.026998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.027184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.027400 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.027580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.027721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.027929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.028110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.028276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.028527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.028664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.028829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.029220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.029364 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.029503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.029654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.029879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.030923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031065 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.031999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.032318 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.032463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.032594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.032743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.032942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.033085 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.033280 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.033426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.033598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.034449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.034654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.034897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.035188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.035411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.035633 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.035776 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.036098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.036232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.036408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.036598 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.036768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.037958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038331 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.038831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.039080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.039354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.039503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.039636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.039636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.040882 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041809 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.041939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.042914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.043068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.043369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.043513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.043675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.043897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044695 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044838 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.044972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.045206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.045354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.045515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.045724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.045867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.046112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.046245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.046421 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.046626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.046762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.047960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.048101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.048265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.048613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.048871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.049019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.049481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.050165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.050380 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.050525 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.050913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.051055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.051324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.051463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.051701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.051875 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.052994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.053189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.053417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.053633 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.053778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.054037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.054173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.054348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.054560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.054710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055006 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055635 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.055967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.056904 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.057061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.057332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.057521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.057782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.057923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.058083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.058653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.058809 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.059958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060735 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.060874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061632 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.061823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.062115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.062316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.062761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.062913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063386 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.063969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.064980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.065546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.065782 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.066143 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.066385 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.066551 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.066715 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.066858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.067872 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.068076 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.068397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.068562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.068685 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.068909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069542 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.069905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070830 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.070957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.071110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.071463 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.071633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.071753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.071906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.072988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073577 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.073995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074311 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074538 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.074951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.075186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.075415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.075498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.075577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.076891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077496 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077799 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.077983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.078885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079207 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079593 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.079937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.080988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.081979 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.082063 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.082287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.082400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.082608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.082712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083198 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.083731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084699 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.084923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085838 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.085990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.086933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.087055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.087229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.087375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.087538 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.087710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.088814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089314 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089514 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.089901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090829 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.090941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.091165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.091302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.091434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.091891 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.091891 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092516 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092638 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092760 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.092993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093104 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093672 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.093902 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094180 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094493 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.094840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095509 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.095966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.096108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.096238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.096928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.097218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.097348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.097679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.097799 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.097942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.098897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099091 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.099930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.100076 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.100426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.100552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.100929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101403 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.101788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.102960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103270 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.103900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104824 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.104944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.105863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106092 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.106960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.107164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.107293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.107515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.107683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.107876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108494 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108812 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.108955 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109239 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.109924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.110926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.111863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.112684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.112916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.113041 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.113219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.113546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.113733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.114891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.115005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.115201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.115320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.115508 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.115635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.119853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.119978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120241 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120457 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120691 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120763 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.120990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121836 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.121987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122280 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122611 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.122990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.123781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.124990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.125282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.125391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.125595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.125929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.126036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.126272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.126522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.126624 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.126919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.127100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.127255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.127532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.127679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.128309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.128881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.129418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.130244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.130474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.130878 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.131205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.131593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.132060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.132457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.132778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.133096 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.133412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.133929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.134975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135075 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.135964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.136966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137119 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137749 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.137902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.138984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.139138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.139285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.139452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.139606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.139752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140197 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.140966 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141580 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.141878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142030 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142525 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.142846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.143867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144321 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.144989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145291 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.145919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.146840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147611 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.147967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148421 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148734 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.148889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.149805 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.150099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.150406 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.150713 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.151843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152785 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.152983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153394 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.153906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.154986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155296 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.155956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.156857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.157828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158155 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.158766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:14:46.159527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.160108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.160575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.160892 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.161205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.161518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.161829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.162140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.162456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.162765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.163074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.163390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.163706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.164062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.164389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.164697 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.165020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.165349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.165704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.166019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.166365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.166693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.167006 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.167316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.167620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:14:46.168198 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:14:46.314479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO dbcounter [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Registered counter for database nova_api Aug 17 16:14:46.323504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO dbcounter [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Registered counter for database nova_api Aug 17 16:14:46.334732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_db.sqlalchemy.engines [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.341488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writer thread running {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.343661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_db.sqlalchemy.engines [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.351230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writer thread running {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.399327 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.context [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37367ca3-7f41-4991-90e4-8af97b9dc4a0(cell1) {{(pid=120793) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 16:14:46.403350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:14:46.403847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:14:46.405448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:14:46.406196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:14:46.406647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:14:46.407509 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.context [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37367ca3-7f41-4991-90e4-8af97b9dc4a0(cell1) {{(pid=120794) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 16:14:46.408683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:14:46.411302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO dbcounter [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Registered counter for database nova_cell0 Aug 17 16:14:46.412444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:14:46.412914 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:14:46.414490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:14:46.415230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:14:46.415391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO dbcounter [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Registered counter for database nova_cell1 Aug 17 16:14:46.415668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:14:46.417673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:14:46.422248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO dbcounter [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Registered counter for database nova_cell0 Aug 17 16:14:46.422984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_db.sqlalchemy.engines [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.423860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO dbcounter [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Registered counter for database nova_cell1 Aug 17 16:14:46.424673 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_db.sqlalchemy.engines [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.430616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writer thread running {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.432701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_db.sqlalchemy.engines [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.433299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writer thread running {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.433651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_db.sqlalchemy.engines [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.441586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writer thread running {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.442002 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writer thread running {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.582324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO dbcounter [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Registered counter for database nova_cell0 Aug 17 16:14:46.588747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO dbcounter [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Registered counter for database nova_cell0 Aug 17 16:14:46.589010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_db.sqlalchemy.engines [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.593641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writer thread running {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.595251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_db.sqlalchemy.engines [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:14:46.600028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writer thread running {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:14:46.928909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: WARNING keystonemiddleware.auth_token [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:14:46.934072 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: WARNING keystonemiddleware.auth_token [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:14:46.936246 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: WARNING keystonemiddleware.auth_token [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:14:46.942482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: WARNING keystonemiddleware.auth_token [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:14:47.292111 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: WARNING keystonemiddleware.auth_token [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:14:47.294509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: WARNING keystonemiddleware.auth_token [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 16:14:47.298155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: WARNING keystonemiddleware.auth_token [None req-0f435148-36e3-4bf7-b09c-f85ed9b48f57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:14:47.301661 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: WARNING keystonemiddleware.auth_token [None req-abfeb8f2-92eb-4124-92e7-3cc62c04609a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 16:14:47.305075 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8439079c0 pid: 120794 (default app) Aug 17 16:14:47.308004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8439079c0 pid: 120793 (default app) Aug 17 16:15:23.460723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.462929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.464174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.465930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:24.913529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f1cedc18-a7e4-4329-80b2-ccccc8f62d48 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Action: 'create', calling method: .version_select at 0x7f9eec344310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1013601974", "metadata": {"Type": "work"}}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:28.505214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f1cedc18-a7e4-4329-80b2-ccccc8f62d48 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.060815 Aug 17 16:15:28.515232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 17 16:15:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5063 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 16:15:28.993347 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e6a673b2-004c-4556-a777-d83f2ffa559e tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Calling method '.version_select at 0x7f9eec3f53a0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:29.032928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.035221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.038219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.039446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:30.300185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e6a673b2-004c-4556-a777-d83f2ffa559e tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7" status: 200 len: 354 microversion: 2.1 time: 1.781773 Aug 17 16:15:30.302468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:15:28 2022] GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 => generated 354 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:15:30.315333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bb76968c-0063-43cc-99e3-4688705b7ada tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Calling method '.version_select at 0x7f9eec1a31f0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:30.424412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bb76968c-0063-43cc-99e3-4688705b7ada tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7" status: 200 len: 354 microversion: 2.1 time: 0.113383 Aug 17 16:15:30.425362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:15:30 2022] GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:15:30.456334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b2a27524-247f-45c3-aae4-245001039dad tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Calling method '.version_select at 0x7f9eec2061f0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:30.676258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b2a27524-247f-45c3-aae4-245001039dad tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7" status: 202 len: 0 microversion: 2.1 time: 0.234732 Aug 17 16:15:30.680256 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:15:30 2022] DELETE /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:15:30.684628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-65328efe-2d0f-4d00-a0fa-b7ae85547dfa tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Calling method '.version_select at 0x7f9eec1a38b0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:31.109473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-65328efe-2d0f-4d00-a0fa-b7ae85547dfa tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7" status: 200 len: 353 microversion: 2.1 time: 0.428493 Aug 17 16:15:31.115291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:15:30 2022] GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 => generated 353 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:15:32.132632 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-335b72fb-65aa-4a5e-a80f-cc3ba41d81a1 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Calling method '.version_select at 0x7f9eec206430>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:32.210191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-335b72fb-65aa-4a5e-a80f-cc3ba41d81a1 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] HTTP exception thrown: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-335b72fb-65aa-4a5e-a80f-cc3ba41d81a1 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Request method failure captured: Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 HTTP/1.1 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQbYay5LCnydfXqFjy0wTIkHgKlIlew4M6cymAPCM-nEjzj51pvCS6Gaa0-yuJBYPjya0IR0zbtpeZw14mJRlA0dRQCzomQpbyzR2qgPbUk9udHdBdcL714LoaLzTWONiVg-3pLHvB5mTTxnvCx5_DXkvaltxiIFtfLAs53CjtSbJ4 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 694ac81eb96c46bf9c999a09e34fb496 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesGetTestJSON-1267114232 Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:15:32.215512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/694ac81eb96c46bf9c999a09e34fb496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/694ac81eb96c46bf9c999a09e34fb496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_694ac81eb96c46bf9c999a09e34fb496", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/694ac81eb96c46bf9c999a09e34fb496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesGetTestJSON-1267114232 Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 694ac81eb96c46bf9c999a09e34fb496 Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesGetTestJSON-1267114232 Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesGetTestJSON-1267114232-project Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: dcb0aae565f84d60a8722c74e83b6682 Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesGetTestJSON-1267114232-project Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '3af06b30-5973-41a2-a226-258a74d059c7'} Aug 17 16:15:32.216929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. (HTTP 404) (Request-ID: req-4caee563-8761-455b-a80c-fd1e0bb2b369) Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:15:32.217553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:15:32.229696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 16:15:32.232528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-335b72fb-65aa-4a5e-a80f-cc3ba41d81a1 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] Returning 404 to user: Volume 3af06b30-5973-41a2-a226-258a74d059c7 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-335b72fb-65aa-4a5e-a80f-cc3ba41d81a1 tempest-VolumesGetTestJSON-1267114232 tempest-VolumesGetTestJSON-1267114232-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7" status: 404 len: 109 microversion: 2.1 time: 0.090093 Aug 17 16:15:32.234836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:15:32 2022] GET /compute/v2.1/os-volumes/3af06b30-5973-41a2-a226-258a74d059c7 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:15:33.569706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1334470165", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "networks": [{"uuid": "9dbbd554-dffd-4cef-98bb-e5a6f96193c7"}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:33.840243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] validate_networks() for [('9dbbd554-dffd-4cef-98bb-e5a6f96193c7', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:15:36.252990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:15:36.254042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:15:36.254687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:15:36.255238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:15:36.255786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:15:36.290493 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:36.290990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:36.291427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:36.292171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:36.292624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:36.301232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:36.427153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Getting quotas for project 0fef305b90d942ea823ca9ba799bb9af. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:15:36.438047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Getting quotas for user d8f2a3a6a0bc461d9e7ba14c8a037b59 and project 0fef305b90d942ea823ca9ba799bb9af. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:15:36.457573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:15:36.461365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:15:36.665151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-750da6e9-03f6-42db-8ab2-833547567b0c tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.004728 Aug 17 16:15:36.666682 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 4/7] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:15:36.680180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b30485cb-c278-4675-9d83-52dfa565d115 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:36.680994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b30485cb-c278-4675-9d83-52dfa565d115 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:37.004492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cd54892f-8ca8-487d-bcf2-9c0df09bf6a0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: .version_select at 0x7f9eecb82160>, body: {"keypair": {"name": "tempest-keypair-611322155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRjs4BwVBj4SkX7+QQurjL2l8shv8hQMk5YC5MeQk2SCw1dTTexlnFkQ5PhgOs81DvJSLMxUglVm8xDM6heqEHf6a9Mlt05pPD8QJvdmpB40DJmylRMJaCtnIYYHW2t9A=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:37.194452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-cd54892f-8ca8-487d-bcf2-9c0df09bf6a0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:15:37.223604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-cd54892f-8ca8-487d-bcf2-9c0df09bf6a0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for user 79729883ac964badae04665e547634da and project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:15:37.434884 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cd54892f-8ca8-487d-bcf2-9c0df09bf6a0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.960173 Aug 17 16:15:37.445831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 4/8] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 17 16:15:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 963 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 16:15:37.515787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b30485cb-c278-4675-9d83-52dfa565d115 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:37.559249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b30485cb-c278-4675-9d83-52dfa565d115 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1215 microversion: 2.1 time: 0.881121 Aug 17 16:15:37.562620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:36 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1215 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:38.585009 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-25acb2d2-e629-404c-b226-cacdc391357d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:38.585627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-25acb2d2-e629-404c-b226-cacdc391357d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:38.736714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-25acb2d2-e629-404c-b226-cacdc391357d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:38.747927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-25acb2d2-e629-404c-b226-cacdc391357d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1215 microversion: 2.1 time: 0.167036 Aug 17 16:15:38.749847 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:38 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:39.179755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2007852496", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:39.425443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] validate_networks() for [('2e3a2be7-1776-4ee7-a497-68ec01d73e19', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:15:39.770857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:39.772191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:39.790644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:39.791351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:39.793068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:39.798892 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:39.799841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:39.800278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:40.255433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:40.278048 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2d91539a-6843-43a2-9921-a296e24d01b3 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1211 microversion: 2.1 time: 0.511410 Aug 17 16:15:40.279714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:39 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1211 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:15:41.310260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:41.314725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:41.340554 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:41.342273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:41.347908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:41.348933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:41.351403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:41.352067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:41.516690 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:41.536451 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-798f15aa-9ab8-4cbf-a827-98a023ca2908 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1273 microversion: 2.1 time: 0.234332 Aug 17 16:15:41.540083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 8/12] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:41 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:41.557064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-245662190", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f750ee49-8cce-4dda-9d0b-14dd03e56eff"}], "security_groups": [{"name": "tempest-securitygroup--779853938"}], "key_name": "tempest-keypair-611322155", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:41.696263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:15:41.696736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:15:41.697164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:15:41.697574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:15:41.697991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:15:41.720779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:41.721481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:41.721722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:41.726331 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:41.729788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:41.733328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:41.797927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] validate_networks() for [('f750ee49-8cce-4dda-9d0b-14dd03e56eff', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:15:41.800870 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:15:41.812978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for user 9fe81a429dee4fba8708445dcefa293e and project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:15:41.903366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:15:41.922241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:15:42.161241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0002ede6-4da7-4ee7-83a2-b98ec8892947 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.598620 Aug 17 16:15:42.165740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 5/13] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:15:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:15:42.188444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7b4a7b62-a89c-4be4-bf31-5ae76164c686 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:42.192197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7b4a7b62-a89c-4be4-bf31-5ae76164c686 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:43.020845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7b4a7b62-a89c-4be4-bf31-5ae76164c686 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:43.054761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7b4a7b62-a89c-4be4-bf31-5ae76164c686 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1222 microversion: 2.1 time: 0.879616 Aug 17 16:15:43.071315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:42 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1222 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:43.095866 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:43.115134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:15:43.115623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:15:43.115844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:43.119053 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:15:43.119503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:15:43.119954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:15:43.144007 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:43.145257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:43.146452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:43.148134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:43.148815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:43.148935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:43.149910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:43.150138 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:43.153602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:43.154282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:43.154939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:43.155863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:43.200536 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:15:43.206372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for user 79729883ac964badae04665e547634da and project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:15:43.231213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:15:43.242033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:15:43.341284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0ce1e899-a457-4dfe-aeb0-7315d6aec5b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.799381 Aug 17 16:15:43.342539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 9/15] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 17 16:15:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 16:15:43.361496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:43.362040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:43.664896 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:43.683467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:43.694185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:43.699946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2c0e6078-9d2f-4c5a-8b0e-e20a7e51f55c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1280 microversion: 2.20 time: 0.349313 Aug 17 16:15:43.719298 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 10/16] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:43 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:43.753105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-787785228", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:43.945972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] validate_networks() for [('2e3a2be7-1776-4ee7-a497-68ec01d73e19', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:15:44.318055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:44.388262 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1d6e44f4-2943-4801-acf5-036b6afb024b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1273 microversion: 2.1 time: 1.311697 Aug 17 16:15:44.401639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 7/17] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:43 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1273 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:44.732202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:44.733067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:45.098711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:45.147017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:45.158366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:45.164930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7384cd6f-1d6c-4c23-8292-a13701fa72be tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1280 microversion: 2.20 time: 0.437668 Aug 17 16:15:45.176503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 8/18] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:44 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:45.361534 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:15:45.362213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:15:45.362916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:15:45.363876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:15:45.364404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:15:45.382450 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:45.386379 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:45.386980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:45.396446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:45.397766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:45.399905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:45.423279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:45.424130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:45.438721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:45.444469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:45.448855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:45.450996 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:45.451642 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:45.454255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:45.472157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:15:45.487414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for user 9fe81a429dee4fba8708445dcefa293e and project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:15:45.539694 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:15:45.562222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:15:45.726124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5e93bbef-211f-43a2-927e-80fb0072848e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.988875 Aug 17 16:15:45.735226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 11/19] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:15:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:15:45.752530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-44a8ca68-8c27-4866-a67d-db793cfd1d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:45.769541 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-44a8ca68-8c27-4866-a67d-db793cfd1d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:45.941101 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-44a8ca68-8c27-4866-a67d-db793cfd1d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:45.948812 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-44a8ca68-8c27-4866-a67d-db793cfd1d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1221 microversion: 2.1 time: 0.205989 Aug 17 16:15:45.952435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 12/20] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:45 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:46.194152 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:46.194777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:46.210776 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:46.211233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:46.219176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:46.222287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:46.225015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:46.233869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:46.668061 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:46.702691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6424f516-8cc0-4233-ba5e-db324d4d6caa tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 1.273292 Aug 17 16:15:46.728243 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 9/21] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:45 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:46.978458 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6fa748e9-fd31-4504-bab9-0a73f7c25f07 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:46.979304 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6fa748e9-fd31-4504-bab9-0a73f7c25f07 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:47.285046 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:47.294031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:47.297954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:47.299565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-46d25c82-d90c-4080-88c4-4221a32ac5c5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1332 microversion: 2.20 time: 1.109965 Aug 17 16:15:47.300648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 13/22] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:46 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1332 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:47.526659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6fa748e9-fd31-4504-bab9-0a73f7c25f07 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:47.544192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6fa748e9-fd31-4504-bab9-0a73f7c25f07 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1221 microversion: 2.1 time: 0.571434 Aug 17 16:15:47.546890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 10/23] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:46 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1221 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:47.733290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:47.734206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:47.754500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:47.758305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:47.760428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:47.761093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:47.764412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:47.764909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:48.329925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:48.330401 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:48.346971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:48.347566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:48.348050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:48.355694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:48.366027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:48.366555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:48.549195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:48.562398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f6fab769-a1ac-4156-a220-fd23cce8436d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.834400 Aug 17 16:15:48.564498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 14/24] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:47 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:48.577281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:48.577979 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:48.596659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:48.597435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:48.597922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:48.598688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:48.603127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:48.603755 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:48.662516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:48.702145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:48.709603 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:48.710828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-79a46fc3-110f-4849-9933-be5a15ba904d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1338 microversion: 2.20 time: 0.385248 Aug 17 16:15:48.711416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 11/25] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:48 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1338 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:15:48.751935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:48.761228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6f75c2fb-8696-4808-9a10-fc2c74b79e9b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1217 microversion: 2.1 time: 0.194809 Aug 17 16:15:48.772571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 15/26] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:48 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:49.594115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:49.595120 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:49.609013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.615771 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.616250 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:49.619476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.619998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.620434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:49.739050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:49.740563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:49.752609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.754944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.755579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:49.757542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.761083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.761732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:49.900330 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:49.913466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:49.917587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:49.919156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5c73e126-06f9-4d1f-845e-9937a176a2f8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1338 microversion: 2.20 time: 0.185588 Aug 17 16:15:49.924260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 16/27] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:49 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:49.948122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:49.948742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:49.965176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.967586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.968278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:49.969775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:49.970521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:49.971132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:50.061701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:50.071305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-93755cf0-00ea-40ac-a815-9bf2ba6857ac tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1217 microversion: 2.1 time: 0.145438 Aug 17 16:15:50.072634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 17/28] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:49 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:50.186268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:50.200581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-de99f7f0-b6d6-4ddc-9811-04a60c691892 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.619091 Aug 17 16:15:50.210441 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 12/29] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:49 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:50.778466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b", "tag": "955a4a4d-b6c2-4cea-8684-7339a37cd0a5"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:50.811916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:50.816276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:50.820344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:50.884888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Creating event network-changed:955a4a4d-b6c2-4cea-8684-7339a37cd0a5 for instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b on hv-cinder-85220 Aug 17 16:15:50.885560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 16:15:50.887163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb579e62-6e88-4ea7-b7bb-6722901b7a39 req-a7ff7ae0-ad5e-4bf8-bf3d-733996c3cef2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 16:15:50.888457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:50.890306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:50.891841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:50.893836 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:50.894709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:50.895693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:50.921239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.compute.rpcapi [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 16:15:50.930442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] Releasing lock "compute-rpcapi-router" {{(pid=120794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 16:15:50.947529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:50.948627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:50.960266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:50.964801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-53c4cfca-4afc-40c6-ad38-6e5a5a7e1320 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347514 Aug 17 16:15:50.965407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 18/30] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:15:50.971432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:50.972148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:50.973636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:50.977444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:50.980497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:51.097084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:51.097781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:51.113261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:51.116177 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:51.118074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:51.118981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:51.120555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:51.123950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:51.249301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:51.274934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:51.283328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:51.288238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b56038bd-e749-41b3-9595-c907c1e85463 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1338 microversion: 2.20 time: 0.345592 Aug 17 16:15:51.290948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 13/31] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:50 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:15:51.308266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:51.309006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:51.339113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:51.354350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:51.355140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:51.361841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:51.362178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9fffe4af-5406-459a-9d6d-3aefa702c6d9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1217 microversion: 2.1 time: 0.271017 Aug 17 16:15:51.363390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 19/32] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:51 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:51.366475 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:51.366948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:51.368679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:51.778123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:52.193687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:52.203008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-70a6a413-afae-4fe0-923c-82b57cca137b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.910965 Aug 17 16:15:52.220871 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 14/33] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:51 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:52.318381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:52.319908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:52.339311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:52.340581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:52.342389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:52.347730 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:52.348455 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:52.350462 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:52.389149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:52.390511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:52.405372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:52.410080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:52.411217 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:52.417724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:52.421263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:52.424835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:52.736880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:52.756995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:52.758632 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:52.759775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0cac97b3-33cc-4e90-8cd0-1a084d8e030f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1338 microversion: 2.20 time: 0.448271 Aug 17 16:15:52.775393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 20/34] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:52 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1338 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:53.236840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:53.237957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:53.256467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:53.263777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:53.263777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:53.263777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:53.263777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:53.264410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:53.341135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:53.357967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-24b34cf9-64ee-437b-9031-fa9448be659b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1273 microversion: 2.1 time: 0.964976 Aug 17 16:15:53.364350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 15/35] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:52 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1273 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:53.806238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:53.807156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:53.848835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:53.849714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:53.850890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:53.855037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:53.857254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:53.858258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:54.820893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:54.844325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7a73c1d4-12b1-4d92-a666-c4aeb13de256 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 1.611203 Aug 17 16:15:54.852737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 21/36] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:53 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:15:54.865702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:54.866517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:54.878882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:54.881968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:54.883114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:54.886216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:54.886334 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:54.887130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:55.074673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:55.088601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ebb3f7fa-8cc0-4dc5-8a52-9bfa887d579c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1279 microversion: 2.1 time: 0.231421 Aug 17 16:15:55.097373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 22/37] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:54 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:55.659625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:55.678334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:55.679882 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:55.681010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-23a477c5-2dc0-46f8-abc4-2a290b2383b6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 1.879230 Aug 17 16:15:55.681559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 16/38] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:53 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:15:55.874896 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:55.876785 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:55.887163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:55.887917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:55.888510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:55.889370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:55.892342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:55.892932 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:55.956184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=26 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:56.115182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:56.115821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:56.125672 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:56.126171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:56.130742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:56.141423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:56.142481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:56.143938 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:56.589212 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:56.605551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-dd3fc774-f4e7-4004-9372-b2645fc578e2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1279 microversion: 2.1 time: 0.492965 Aug 17 16:15:56.608603 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 17/39] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:56 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:56.674154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:56.687384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a61488b9-3054-4a3a-8610-772a527e9539 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.816339 Aug 17 16:15:56.693105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 23/40] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:55 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:56.704732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:56.706142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:56.722190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:56.724971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:56.726406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:56.727340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:56.729621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:56.733199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:57.303958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153d19a6-a000-4320-8e36-d1528026298f", "tag": "1b394726-e1b8-49fa-afe3-9e3fad19f1ae"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:57.326331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:57.326817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:57.330437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:57.345706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] Creating event network-changed:1b394726-e1b8-49fa-afe3-9e3fad19f1ae for instance 153d19a6-a000-4320-8e36-d1528026298f on hv-cinder-85220 Aug 17 16:15:57.366360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-0817e790-ead5-4af9-bdd2-c3df9f9eeee2 req-dea63507-38e3-46be-a22c-c012f6220c2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248269 Aug 17 16:15:57.367431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 24/41] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:15:57.532685 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=16 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:57.630968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:57.631876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:57.652596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:57.653493 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:57.654100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:57.655121 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:57.656817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:57.657749 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:57.880789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:57.924955 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:57.932382 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:57.951132 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-68e3b159-f37e-4b9a-bd4b-9c25e8d32204 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 1.238407 Aug 17 16:15:57.959917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 18/42] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:56 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:57.974590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:57.977705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:58.001426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:58.002400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:58.004818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:58.008518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:58.008518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:58.009905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:58.023694 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:58.036810 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-578619e5-5237-4cda-8a07-c4ec7b8d09e1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1279 microversion: 2.1 time: 0.408609 Aug 17 16:15:58.037659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 25/43] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:57 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1279 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:15:58.435897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:58.452240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7bfd4017-1901-4d6d-83de-60b9631c078d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.489704 Aug 17 16:15:58.469694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 19/44] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:57 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:15:58.516143 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:15:58.547890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:58.548574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:58.549098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:58.624480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] Creating event network-changed:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:15:58.669467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-87b765f8-a3f2-4481-bc20-189056bf4ba9 req-ab9db2d2-1aa2-48bd-a560-9357a0669fea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158355 Aug 17 16:15:58.675395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 26/45] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:15:58.984001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:58.985424 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:59.016371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.020060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.021610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:59.024460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.028695 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.029162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:59.071967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:59.074424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:59.097857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:59.115188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.117657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.120525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:59.121546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.125351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.126987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:59.760442 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:59.797547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:59.799744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:15:59.818960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7567761c-0152-4639-861e-2378def2c6eb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.839608 Aug 17 16:15:59.824325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 20/46] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:15:58 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:15:59.837371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:15:59.841446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:15:59.866275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:59.887848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.890188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.895736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:15:59.897822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:15:59.900492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:15:59.919441 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.364832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:00.393420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-860cb629-41ce-4978-9236-ccecaa13a3c4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 1.332826 Aug 17 16:16:00.396573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 27/47] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:59 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:00.480130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:00.493237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-84c58109-e1d1-406e-a5a7-169b3371dbf6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.657410 Aug 17 16:16:00.504979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 21/48] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:15:59 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:00.847331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:00.848064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:00.856004 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:00.856810 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:00.857738 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.858786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:00.860337 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:00.861447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.895724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.909070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed26661-073f-4069-a175-c74cc4346cac", "tag": "1493823e-675a-4f33-9189-631883a599da"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:00.920588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=8 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.925849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:00.926595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:00.927519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.954328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Creating event network-changed:1493823e-675a-4f33-9189-631883a599da for instance 3ed26661-073f-4069-a175-c74cc4346cac on hv-cinder-85220 Aug 17 16:16:00.954903 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 16:16:00.955300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c1c4f27e-96d4-4d7b-8a7f-dea8dad6f8c5 req-a90bb017-7dbe-4af3-88e6-7feb145e5b7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 16:16:00.956384 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:00.956827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:00.957253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.960400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:00.960400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:00.960400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:00.969051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.compute.rpcapi [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 16:16:00.969891 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] Releasing lock "compute-rpcapi-router" {{(pid=120793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 16:16:00.994599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1bd5db70-e74d-4378-bcd7-742468ef2eb7 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090610 Aug 17 16:16:00.995523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 22/49] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:16:01.100537 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:01.108916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:01.112082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:01.113862 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e2c81b3f-f9d1-4a75-b5c3-559bec317580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.271479 Aug 17 16:16:01.114610 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 28/50] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:00 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:01.429325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:01.431310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:01.455068 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:01.455559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:01.456534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:01.457555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:01.457949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:01.458619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:01.521980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:01.522593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:01.529080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:01.529822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:01.530562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:01.532168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:01.532823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:01.533247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:01.642020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:01.650659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3cd8a269-71bb-4b86-99f2-b962604282b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.241682 Aug 17 16:16:01.664324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 23/51] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:01 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:01.691624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:01.713178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-31a116a8-63e0-43c4-b687-3a8c5a83a4cd tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.197748 Aug 17 16:16:01.726993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 29/52] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:01 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:02.141564 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:02.143446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:02.152070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.153055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.153864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.154833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.155292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.155716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.472273 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:02.489538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:02.492125 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:02.493726 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-768845a8-3e86-453e-ac4d-a8aa70d96402 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.360307 Aug 17 16:16:02.509917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 24/53] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:02 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:02.678275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:02.679950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:02.691530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.692293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.693553 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.694498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.695235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.695916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.734129 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:02.735179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:02.744087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.745915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.746590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.748888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:02.749590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:02.750626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:02.833556 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:02.950313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:02.960842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d407ca44-ec94-4417-be41-6fd2d1f57739 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.293468 Aug 17 16:16:02.971589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 30/54] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:02 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:03.104487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:03.113184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8e8868dc-128e-4502-af13-fcb31a0e816d tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.383197 Aug 17 16:16:03.115641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 25/55] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:02 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:03.519560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:03.520159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:03.529582 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:03.530073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:03.530508 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:03.531888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:03.532340 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:03.532759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:03.720587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:03.730549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:03.732098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:03.733510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e94b2586-107f-4c77-917b-98bc44298a5f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.218738 Aug 17 16:16:03.744490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 31/56] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:03 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:03.992042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:03.992641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:03.999093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.000051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.000687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.001377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.001971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.002536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.136944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:04.138134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:04.145929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.146637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.147118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.147991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.148629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.149191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.155161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:04.164756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0bfd0d63-22e5-4506-a8f5-501e44ab5537 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.176471 Aug 17 16:16:04.165341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 26/57] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:03 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:04.326390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:04.339556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8e482be2-21ec-485b-9751-bcad87b110a9 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.207363 Aug 17 16:16:04.340324 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 32/58] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:04 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:04.757622 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:04.758223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:04.794770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.795278 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.795718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.796430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:04.797201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:04.797883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:04.979114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:04.990445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:04.992126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:04.993323 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4d2add90-e7d8-4aef-a344-d22053e5105e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.241951 Aug 17 16:16:04.994233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 27/59] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:04 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:05.187688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:05.188918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:05.195322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:05.196014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:05.196602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:05.197473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:05.198063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:05.198616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:05.370682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:05.371948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:05.387380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:05.389428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:05.392140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:05.393110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:05.393544 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:05.394016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:05.394637 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:05.404124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4a3ea37a-d322-44de-8c8e-9aac64179ae8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.220167 Aug 17 16:16:05.405126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 33/60] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:05 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:05.658167 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:05.665846 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-903204b0-2368-4edf-b090-59da11a19d75 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.301697 Aug 17 16:16:05.666667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 28/61] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:05 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:06.017634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:06.018961 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:06.024548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.025102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.025741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.026644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.027102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.027522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.217070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:06.225573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:06.227322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:06.228663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-44ba4433-6e4f-4232-8258-28430060ec61 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.216185 Aug 17 16:16:06.229378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 34/62] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:06 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:06.426685 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:06.427298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:06.433771 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.434268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.435124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.435834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.436291 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.436715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.611844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:06.620375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-09436e5e-68fd-4469-b24e-78ee877b208d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.197638 Aug 17 16:16:06.620940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 29/63] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:06 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:06.691052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:06.691972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:06.698412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.698891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.699505 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.700386 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:06.700828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:06.701419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:06.841342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:06.850652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bef042f5-7892-41e9-b07a-a1a02ceb0611 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.163665 Aug 17 16:16:06.851228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:06 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:07.251313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:07.252270 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:07.258917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.259658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.260390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:07.261275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.261908 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.262615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:07.412209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:07.422272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:07.424136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:07.425322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d4fe0906-488a-4092-874c-7052c8c1c903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.178730 Aug 17 16:16:07.425877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 30/65] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:07 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:07.643151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:07.644386 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:07.650951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.651627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.652081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:07.652935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.653531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.654217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:07.826628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:07.840272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d1bec9b4-08da-4a75-bccf-cff5cfd8c55e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.199930 Aug 17 16:16:07.843516 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 36/66] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:07 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:07.872427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:07.873049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:07.880183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.880663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.881094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:07.881793 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:07.882379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:07.882974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:08.120123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:08.149017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-924cb21c-7961-445e-ac4c-a1c2d74c4dbc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.279779 Aug 17 16:16:08.149621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 31/67] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:07 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:08.446935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:08.448612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:08.461948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:08.464545 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:08.465088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:08.468882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:08.469655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:08.473924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:08.861420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:08.863512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:08.864275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:08.873751 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:08.876882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:08.878449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3fbdbd16-c6bd-4483-b568-b1e90477afc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.435678 Aug 17 16:16:08.880058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 37/68] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:08 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:08.884826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:08.886234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:08.886881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:08.888739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:08.890049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:08.891084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:09.077092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:09.088234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8b54f7e8-0e1f-48a3-82f5-b6f76124dd20 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.229835 Aug 17 16:16:09.090323 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 32/69] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:08 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:09.178839 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:09.179445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:09.189559 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:09.190093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:09.190386 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:09.194567 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:09.195084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:09.195520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:09.394393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:09.405247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-44ff18cf-0c5f-41c2-b8e4-2c6fe7c78c57 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.237143 Aug 17 16:16:09.406265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 38/70] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:09 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:09.901535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:09.902142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:09.908798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:09.909525 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:09.910114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:09.910808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:09.911419 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:09.911859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:10.111029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:10.112264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:10.118304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:10.118953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:10.119655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:10.120983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:10.121591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:10.122185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:10.129188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:10.138454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:10.141939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:10.144050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-68a11422-7e59-4b15-8faf-415485d11b76 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.246254 Aug 17 16:16:10.145501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 33/71] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:09 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:10.403491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:10.413273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c634a392-a474-452c-9af0-2df92b4b070d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.306537 Aug 17 16:16:10.424263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:10 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:10.427156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:10.428031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:10.434160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:10.434732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:10.435220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:10.436006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:10.436516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:10.437036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:10.595075 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:10.605870 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-06672b27-0471-4a04-a7c0-fd6e184363f0 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.182716 Aug 17 16:16:10.607035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 34/73] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:10 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:11.166799 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:11.167403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:11.173789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.174262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.174686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.175360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.175827 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.176241 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.308458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:11.316866 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:11.318363 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:11.319453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7c966593-6ed3-4645-8cbd-055846d43ca9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.156849 Aug 17 16:16:11.320029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 40/74] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:11 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:11.434809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:11.435657 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:11.438510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:11.444326 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.444805 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.445230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.445914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.446356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.446768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.574876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:11.583232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4d5969f6-0640-4c7e-ac9a-e58bf78a6a69 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.152594 Aug 17 16:16:11.583784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 35/75] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:11 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:11.629545 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:11.630151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:11.636093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.636564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.636989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.637661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:11.638106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:11.638519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:11.772464 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:11.779969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-54555990-5800-47b5-939d-d30f4e529bd7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.154177 Aug 17 16:16:11.780529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 41/76] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:11 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:12.342272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:12.342958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:12.349632 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.350735 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.351363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:12.352456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.353124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.353739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:12.571928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:12.590888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:12.598877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:12.608828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:12.609370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e7973d93-3208-4d5a-b4d5-50b7714e82a6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.270563 Aug 17 16:16:12.611405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:12.628488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 36/77] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:12 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:12.628626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.630735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.631201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:12.639223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.639708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.640960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:12.809635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:12.810317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:12.833878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.834379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.834816 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:12.835589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:12.836062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:12.836485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:13.016502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:13.037396 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2a4214ca-108d-4de5-9d96-cec54b157ba4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.436454 Aug 17 16:16:13.037987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:12 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:13.175332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:13.189431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0bc0d72c-7a8f-4af6-843d-92581d1e5659 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.386925 Aug 17 16:16:13.189431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:12 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:13.634447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:13.635057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:13.642111 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:13.642847 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:13.643269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:13.643992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:13.644434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:13.644846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:13.798277 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:13.806287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:13.807784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:13.809132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bce6db9b-64c8-4c09-8d0b-b67864a1a914 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.178526 Aug 17 16:16:13.809705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 43/80] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:13 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:14.060312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:14.060993 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:14.067188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.067667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.068133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.068821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.069269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.069691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.195779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:14.203261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-57ad6ad9-0a27-476a-b99c-16b59f349dc9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.146948 Aug 17 16:16:14.204374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 38/81] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:14 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:14.206453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:14.207062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:14.212947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.213414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.213836 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.214507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.214947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.215357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.346147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:14.349549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:14.355132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-feb4c9a9-a3b7-43e5-8761-0628ef01a106 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.153708 Aug 17 16:16:14.356040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 44/82] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:14 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:14.831335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:14.831990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:14.838016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.838487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.838912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.839756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:14.840037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:14.840475 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:14.969425 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:14.977584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:14.979102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:14.980218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9ec16b5c-c223-477e-a8e3-93d9ce7bfa64 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.153042 Aug 17 16:16:14.980783 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 39/83] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:14 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:15.223555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:15.224185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:15.230476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:15.230944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:15.231369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:15.232074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:15.232583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:15.232999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:15.362034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:15.369402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e88ba01d-a241-47ad-9bb4-7da3e5fef2fd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.150046 Aug 17 16:16:15.370161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 45/84] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:15 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:15.376328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:15.376997 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:15.382950 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:15.383429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:15.383895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:15.384579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:15.385021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:15.385433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:15.510643 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:15.518351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-402ee6e9-a98b-4c22-86d9-3f4ad94c62d7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.146439 Aug 17 16:16:15.518907 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:15 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:16.003098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:16.003622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:16.011680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.012181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.012604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.013279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.013722 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.014133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.154463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:16.163093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:16.164600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:16.165698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-907b263f-5548-41fa-8458-b4568333ca0f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.167080 Aug 17 16:16:16.166249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 46/86] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:15 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:16.392993 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:16.393602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:16.399475 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.399984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.400413 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.401089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.401531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.401947 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.540438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:16.541865 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:16.548202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:16.548922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.549410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.549839 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.550529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.550973 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.551391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.558538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ee6ab2d0-e8ae-407f-a323-43e94486ec88 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.172391 Aug 17 16:16:16.559115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 41/87] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:16 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:16.681724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:16.690067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-13887c0b-301a-4acf-8f4f-78047c9d83a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.154886 Aug 17 16:16:16.690815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 47/88] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:16 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:16.891514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b", "name": "network-vif-plugged", "status": "completed", "tag": "955a4a4d-b6c2-4cea-8684-7339a37cd0a5"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:16.901014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:16.901478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:16.901896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:16.905553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:16.914148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] Creating event network-vif-plugged:955a4a4d-b6c2-4cea-8684-7339a37cd0a5 for instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b on hv-cinder-85220 Aug 17 16:16:16.919366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-b8977225-ad5a-4260-8f6d-a8ef72ec7fb3 req-a83857d1-cdea-4e63-8d5f-9c54ae2f553d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093930 Aug 17 16:16:16.919978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 42/89] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:17.189784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:17.190497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:17.196461 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.197014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.197576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.198394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.198925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.199417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.335860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:17.346756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:17.348290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:17.349384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-241eb2ef-31d5-4c11-8e56-c7e40eb266a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.164802 Aug 17 16:16:17.350183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 48/90] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:17 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:17.579894 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:17.580627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:17.587215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.587481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.588341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.589836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.589836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.589836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.710492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:17.711102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:17.717010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.717491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.717923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.718606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:17.719843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:17.720343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:17.721791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:17.729423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3524c26c-feb4-42a6-aa1a-6702bc181f7a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.154002 Aug 17 16:16:17.729987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 43/91] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:17 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:17.851167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:17.859122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ff3d7db0-eeb8-4802-9744-3b4e43b00197 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.152444 Aug 17 16:16:17.859699 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 49/92] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:17 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:18.372026 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:18.372629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:18.379192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.379659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.380111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.380782 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.381220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.381630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.506474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:18.514198 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:18.515704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:18.517096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-77752f0d-c605-4ec6-9a04-db3b1dbd8dc1 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.148849 Aug 17 16:16:18.517648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 44/93] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:18 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:18.749912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:18.751091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:18.756980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.757451 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.757880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.758576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.759027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.759440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.879789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:18.881030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:18.886338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:18.886968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.887445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.887895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.888576 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:18.889183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:18.889597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:18.895376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-67550fe9-65f7-4104-8c7e-1bd8b07bfe44 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.149342 Aug 17 16:16:18.897019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 50/94] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:18 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:19.018453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:19.025758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1b6d08d0-dbb7-453e-9f37-9e84de73919b tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.150023 Aug 17 16:16:19.026321 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 45/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:18 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:19.538954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:19.539557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:19.545490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:19.545957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:19.546382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:19.547064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:19.547504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:19.547946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:19.696049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:19.705561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:19.707071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:19.708232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e82e87bd-2db4-464a-b9dc-e4696bbaf2ec tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.173082 Aug 17 16:16:19.708796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 51/96] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:19 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:19.920202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:19.921472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:19.931532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:19.932410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:19.933373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:19.934271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:19.934874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:19.935402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.049708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:20.050323 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:20.059483 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:20.060311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:20.061164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.062033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:20.063329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:20.063911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.118207 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:20.129006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2ee59065-c5af-43bd-9ed8-2a49f628eead tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.212610 Aug 17 16:16:20.130166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 46/97] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:19 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:20.199685 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "name": "network-vif-plugged", "status": "completed", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:20.209989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:20.210596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:20.210962 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.223512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] Creating event network-vif-plugged:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:16:20.226853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:20.230508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-1f346027-9c60-43ff-9f21-2c0827472853 req-86557333-f1d9-4b3a-bea9-20012c8f24d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034509 Aug 17 16:16:20.231452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 47/98] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:16:20.236167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-32a3fffb-bce0-4443-9fd6-3cf93cca2d53 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.191302 Aug 17 16:16:20.236724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 52/99] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:20 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:20.731274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:20.731989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:20.738615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:20.739082 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:20.739506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.740218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:20.740658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:20.741071 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:20.880845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:20.888927 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:20.890437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:20.892324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2482f439-a722-4e57-9e7e-682521efc580 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.165270 Aug 17 16:16:20.892883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 48/100] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:20 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:21.149629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:21.150527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:21.157336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.157867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.158338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:21.159967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.159967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.159967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:21.257146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:21.257762 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:21.264379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.265220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.266528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:21.267516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.268008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.268434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:21.318083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:21.327013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2944b71c-eab3-4945-80b1-f50b13725374 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.180723 Aug 17 16:16:21.334997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 53/101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:21 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:21.428742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:21.440130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-185888c6-6dbe-4f20-94e5-32a29e1c0099 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.186758 Aug 17 16:16:21.440883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 49/102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:21 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:21.918526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:21.919122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:21.925417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.925822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.926242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:21.926911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:21.927350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:21.927756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:22.065778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:22.073833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:22.075543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:22.076778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fd3594f3-3ab0-40b3-bafc-d1dca7227e1b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.162134 Aug 17 16:16:22.077336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 54/103] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:21 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:16:22.354665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:22.355310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:22.362094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:22.362575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:22.363005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:22.363693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:22.364170 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:22.364592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:22.465136 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:22.466427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:22.477165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:22.477641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:22.478067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:22.478754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:22.479200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:22.479616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:22.497515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:22.506079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1dcd2beb-ccf1-47e0-82da-70c0873f24fe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.155236 Aug 17 16:16:22.506650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 50/104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:22 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:22.606981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:22.615348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e0bcf499-5710-4ac6-9063-2e210530cdac tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.155011 Aug 17 16:16:22.616265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 55/105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:22 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:23.099062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:23.099572 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:23.105913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.106381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.106797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.107469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.107934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.108347 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.239798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:23.247729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:23.249308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:23.251097 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-050b7b54-8ac0-4c6a-9079-de244e1776a8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.156027 Aug 17 16:16:23.251787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 51/106] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:23 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:16:23.527137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:23.529581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:23.536604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.537208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.537821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.538520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.540001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.540433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.636311 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:23.636914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:23.646143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.646921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.647418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.648186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:23.648764 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:23.649183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:23.697089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:23.707942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cdb29a51-4fd5-47e8-bec0-f4f60637f415 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.185088 Aug 17 16:16:23.719533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 56/107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:23 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:23.803826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:23.811670 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-90356de8-ab08-4bc5-80cb-ce65d05f0ef7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.179143 Aug 17 16:16:23.812307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 52/108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:23 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:24.272985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:24.273583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:24.279510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.280024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.280450 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.281137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.282172 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.282584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.434200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:24.443868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:24.449827 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:24.450972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2fbc14bd-ac9a-42eb-a638-a0ac7d443e3a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.181902 Aug 17 16:16:24.451540 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 57/109] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:24 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:24.731303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:24.731942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:24.738765 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.739232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.739654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.740358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.740793 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.741202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.833864 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:24.835798 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:24.845095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.846295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.847122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.848033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:24.848693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:24.849291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:24.877265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:24.886039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1d56d58e-ac95-4fbb-8de9-f390cfbcd15e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.158466 Aug 17 16:16:24.886809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 53/110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:24 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:24.995648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:25.003495 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fcc30bb8-c59d-43e8-8635-79b607c52a31 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.173598 Aug 17 16:16:25.004084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 58/111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:24 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:25.473380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:25.473980 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:25.480348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:25.480826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:25.481263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:25.481940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:25.482387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:25.482805 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:25.609008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:25.617622 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:25.619130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:25.620252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6699b7ae-e526-4895-bf62-65fafeb748d3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.150785 Aug 17 16:16:25.620820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 54/112] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:25 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:25.907905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:25.908535 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:25.918690 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:25.919209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:25.919639 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:25.920471 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:25.920872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:25.921317 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.024337 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:26.024933 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:26.030833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:26.032006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:26.032407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.033094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:26.033544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:26.033959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.058543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:26.066014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fef98a22-5ec6-4858-8786-9b40fa22cc1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.162194 Aug 17 16:16:26.066588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 59/113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:25 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:26.163183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:26.170990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-86e74be3-efbf-483c-9678-3aacda82fdd2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.150513 Aug 17 16:16:26.171641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 55/114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:26 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:26.643036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:26.643636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:26.649932 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:26.650404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:26.650822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.651501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:26.652107 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:26.652603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.790108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:26.799058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:26.800686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:26.801849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1ad1be0b-2b93-4b9c-bad1-ab50cbcf2f07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.163539 Aug 17 16:16:26.802785 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 60/115] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:26 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:26.907048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153d19a6-a000-4320-8e36-d1528026298f", "name": "network-vif-plugged", "status": "completed", "tag": "1b394726-e1b8-49fa-afe3-9e3fad19f1ae"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:26.925406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:26.925982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:26.926692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:26.946933 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] Creating event network-vif-plugged:1b394726-e1b8-49fa-afe3-9e3fad19f1ae for instance 153d19a6-a000-4320-8e36-d1528026298f on hv-cinder-85220 Aug 17 16:16:26.963534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-fd7d996a-b526-472f-aecb-3f8a21d80f08 req-b709f66a-8171-4032-8c19-035213c16ee0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060000 Aug 17 16:16:26.964168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 56/116] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:27.086521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:27.087224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:27.094877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.095978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.096963 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:27.097871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.098525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.099118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:27.121787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.194915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:27.198844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:27.210610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.211401 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.212143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:27.219164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.220398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.221332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:27.275761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:27.285027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c8aced66-ce5d-4ae5-a1e1-30058d4e062b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.202286 Aug 17 16:16:27.286171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 61/117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:27 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:27.449466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:27.461379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cc5517fb-6a6e-4173-8e43-dab4431a6f39 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.271837 Aug 17 16:16:27.462281 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 57/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:27 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:27.828825 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:27.829795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:27.836108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.836953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.838215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:27.839356 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:27.840068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:27.840745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:28.007636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:28.016481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:28.018094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:28.019206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-84e6f3ff-ae78-43b6-b09d-77f0fd07b41d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.195923 Aug 17 16:16:28.019762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 62/119] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:27 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:28.307656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:28.309191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:28.317287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:28.318172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:28.318756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:28.319662 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:28.320227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:28.320719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:28.482849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:28.483464 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:28.496743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:28.497960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:28.501704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:28.520701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:28.521410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:28.522001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:28.532651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:28.534716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-860e4d74-c968-4df2-878f-2ea646624de6 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.231674 Aug 17 16:16:28.535847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 58/120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:28 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:28.841399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:28.854055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fe8e2a8b-92d2-42d2-8ecb-09e459e86a49 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.375265 Aug 17 16:16:28.855205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 63/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:28 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:28.980241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed26661-073f-4069-a175-c74cc4346cac", "name": "network-vif-plugged", "status": "completed", "tag": "1493823e-675a-4f33-9189-631883a599da"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:29.004324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.006328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.006922 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.025972 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] Creating event network-vif-plugged:1493823e-675a-4f33-9189-631883a599da for instance 3ed26661-073f-4069-a175-c74cc4346cac on hv-cinder-85220 Aug 17 16:16:29.034211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-550c3f14-34c1-4d85-91be-9346de933e85 req-338428e0-648d-4797-b7c0-03c755fed091 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058803 Aug 17 16:16:29.034857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 59/122] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:29.045886 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:29.047748 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:29.067108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.067600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.068266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.068999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.069543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.069970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.241501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:29.251523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:29.253484 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:29.255599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2b411f1e-2e85-4505-9498-de10a31bf5bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.215679 Aug 17 16:16:29.267828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 64/123] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:29 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:16:29.557892 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:29.558581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:29.568000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.568477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.569071 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.569756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.570227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.570640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.714819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:29.722433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1f8f8730-5984-49a8-a2f5-a25f87e5b105 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.168524 Aug 17 16:16:29.723188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 60/124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:29 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:29.875940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:29.876642 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:29.878516 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=75 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.884036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.884524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.884951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:29.885656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:29.886089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:29.886504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:30.043312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:30.051522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5ff25c8c-5332-49a9-b9e6-0b851f090bf1 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.179630 Aug 17 16:16:30.052123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 65/125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:29 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:30.283686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:30.284556 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:30.286889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=80 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:30.293543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:30.294002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:30.294429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:30.295663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:30.296342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:30.297499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:30.321182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:30.477969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:30.486861 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:30.488604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:30.489894 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3bd64169-83e0-4595-9347-cbd813a088b3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.212907 Aug 17 16:16:30.490626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 61/126] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:30 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:30.743887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:30.744487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:30.751208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:30.751688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:30.752137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:30.752807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:30.753247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:30.753658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:30.886497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:30.894136 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-355d6c24-8eb7-4da9-a8d0-46b251d39982 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.154098 Aug 17 16:16:30.894706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 66/127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:30 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:31.072554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:31.073182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:31.079471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.079869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.080298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:31.080979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.081430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.081845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:31.217899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:31.226276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e3fb642d-c793-4f0b-bf11-6947d39d0a72 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1315 microversion: 2.1 time: 0.157555 Aug 17 16:16:31.226843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 62/128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:31 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:31.513338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:31.513960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:31.520681 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.521153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.521575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:31.522247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.522688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.523094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:31.657479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:31.665487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:31.667037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:31.668096 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-38991e76-b6ed-4ec5-8a9e-7d7e8d4f5140 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1405 microversion: 2.20 time: 0.159040 Aug 17 16:16:31.668642 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 67/129] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:31 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:31.914545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:31.915226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:31.921387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.922423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.922852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:31.923717 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:31.924200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:31.924700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:32.059325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:32.067700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f7e79993-2755-4271-851a-7c83307435d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.157149 Aug 17 16:16:32.068294 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 63/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:31 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:32.246506 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:32.247028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:32.253741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:32.254208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:32.254630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:32.255297 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:32.255735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:32.256171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:32.391786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:32.399173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0aa57c36-32dd-4b0b-8154-f9b6b3574005 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1502 microversion: 2.1 time: 0.156523 Aug 17 16:16:32.399746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 68/131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:32 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:32.691968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:32.693239 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:32.708028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:32.709271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:32.713011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:32.714319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:32.714934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:32.716433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:32.943387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:32.962464 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:32.965229 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:32.966896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1594749d-27ba-40b0-9f1b-ee9068798552 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1597 microversion: 2.20 time: 0.279568 Aug 17 16:16:32.969633 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 64/132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:16:32 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1597 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:16:32.992364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:32.993262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:32.999256 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:32.999841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:33.000268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:33.000960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:33.001410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:33.001825 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:33.089427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:33.092991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:33.101169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:33.101169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:33.101736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:33.102644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:33.103375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:33.104287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:33.164674 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c13cd474-dd95-490d-8f77-090db935bc17 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176036 Aug 17 16:16:33.165237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 69/133] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 17 16:16:32 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:16:33.296941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:33.305792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0ba5660e-09d6-49c1-9bcb-e5d2c9837768 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.220298 Aug 17 16:16:33.316275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 65/134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:33 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:34.136748 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3197842c-328b-40e9-a87d-443941b32dbc"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:34.139147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:34.145775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:34.146247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:34.146676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:34.147357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:34.147823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:34.148244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:34.327792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:34.328408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:34.334939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:34.335414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:34.335883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:34.336570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:34.337015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:34.337426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:34.567234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:34.578674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0e649b84-0954-4461-83f3-182cf5e2419b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1321 microversion: 2.1 time: 0.254023 Aug 17 16:16:34.583849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 66/135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:34 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:34.748909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-16f72847-2d0d-4c36-bf0d-65da2dfa6f03 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "POST /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615928 Aug 17 16:16:34.756018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 70/136] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:16:34 2022] POST /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:34.848863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:34.860428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:34.860987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:34.861418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:34.873354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] Creating event network-changed:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:16:34.879195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-d5e53d99-a4fe-4f9c-a121-24ef6d430143 req-b121322d-ed0c-4c54-8207-e885e39049e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041954 Aug 17 16:16:34.880139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 67/137] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:35.602016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:35.602985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:35.609717 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:35.610371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:35.611106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:35.611936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:35.612479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:35.613116 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:35.777243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:35.785397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8a3a7dc6-b667-4ebd-961d-f40470f18a7d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1514 microversion: 2.1 time: 0.188812 Aug 17 16:16:35.786091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 71/138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:35 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:35.811317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:35.814304 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:35.820628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:35.821881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:35.822484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:35.823339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:35.823981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:35.824551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:35.903465 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lazy-loading 'flavor' on Instance uuid 3ed26661-073f-4069-a175-c74cc4346cac {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:16:36.028791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1085c5c2-dd98-471a-9bd4-568f5caa9221 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac/action" status: 200 len: 32 microversion: 2.1 time: 0.221345 Aug 17 16:16:36.029437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 68/139] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:16:35 2022] POST /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:16:36.040675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:36.041355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:36.048575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:36.049066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:36.049713 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:36.050580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:36.051212 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:36.051826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:36.209057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:36.216670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-77afa1bf-2aa4-407a-8da5-c011d6796c89 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.180829 Aug 17 16:16:36.217239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 72/140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:36 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:37.240661 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:37.241855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:37.248243 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:37.248715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:37.249139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:37.250387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:37.250822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:37.251232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:37.384011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:37.392267 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-66efd206-8f49-4595-ad0c-3916624e4ad3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.155632 Aug 17 16:16:37.392839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 69/141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:37 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:38.413077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:38.413703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:38.420174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:38.420657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:38.421103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:38.422384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:38.422992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:38.423417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:38.577132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:38.585023 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ce003264-a77c-4eca-bd76-375c2282726b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.175901 Aug 17 16:16:38.591928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 73/142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:38 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:39.606879 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:39.607749 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:39.614493 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:39.614971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:39.615396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:39.616105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:39.617181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:39.617605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:39.832898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:39.848744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-907e8199-e851-423d-9daf-deada5331141 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.246378 Aug 17 16:16:39.850276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 70/143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:39 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:40.875601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:40.876265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:40.885167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:40.885653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:40.886369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:40.887228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:40.887593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:40.888002 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:41.101597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:41.112929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-693c2d3c-96e4-49b3-95e3-2c2ecc72fc05 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.242927 Aug 17 16:16:41.125086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 74/144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:40 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:42.135285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:42.136021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:42.144013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:42.144596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:42.144930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:42.145624 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:42.146054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:42.146462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:42.293177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:42.335049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6e0d0fd4-48f3-464b-b3ec-7165b9a7eabf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.203424 Aug 17 16:16:42.336319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 71/145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:42 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:43.357617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:43.359163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:43.366247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:43.367107 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:43.367473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:43.368261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:43.368787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:43.369267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:43.530909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:43.538888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6d882028-bf44-43c6-ad4d-6d55daaa1d4f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.184981 Aug 17 16:16:43.539540 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 75/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:43 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:44.563108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:44.563776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:44.581485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:44.582173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:44.582822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:44.583753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:44.584484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:44.585136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:44.778493 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:44.798382 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5ba9df68-42f7-45e2-abc2-f08f094a30a1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.240735 Aug 17 16:16:44.799321 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 72/147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:44 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:45.821082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:45.821702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:45.831466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:45.831982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:45.837239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:45.838193 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:45.838818 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:45.839413 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:46.072007 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:46.088882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-afedc994-3ebf-4f2c-a9fd-3612195888bb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.271521 Aug 17 16:16:46.089560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 76/148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:45 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:47.114380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:47.114983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:47.123066 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:47.125328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:47.126276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:47.133936 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:47.134724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:47.136203 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:47.367473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:47.379237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e10efa3e-3f48-4084-a01d-aa84f52a3007 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.272010 Aug 17 16:16:47.380460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 73/149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:47 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:48.401384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:48.402772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:48.411056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:48.411534 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:48.412160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:48.413060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:48.413500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:48.413917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:48.437466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.568433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:48.580463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-04114993-fd71-49bf-988d-c220202fd87e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.181602 Aug 17 16:16:48.595871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 77/150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:48 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:49.120381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:49.120869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:49.127835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.128318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.128754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.132443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.132949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.133356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.166946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:16:49.272117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c68d422e-5cfc-4bd6-9979-e22116456583 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 204 len: 0 microversion: 2.1 time: 0.155624 Aug 17 16:16:49.272714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 74/151] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:16:49 2022] DELETE /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:16:49.285286 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:49.286417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:49.293149 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.293913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.294846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.295716 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.296398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.296825 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.472020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:49.480600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e8bd640b-6ef3-459b-a999-dae1c5bffcd6 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1554 microversion: 2.1 time: 0.202691 Aug 17 16:16:49.481178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 78/152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:49 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:49.610641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:49.611339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:49.617384 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.617865 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.618513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.619297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:49.619746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:49.620340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:49.625554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.821391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:49.847191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c0818071-4f6c-497b-a24d-f45c878dff56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.246159 Aug 17 16:16:49.847774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 75/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:49 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:50.518526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:50.519163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:50.538885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:50.539757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:50.547496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:50.548449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:50.549043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:50.549589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:50.788458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:50.799377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bb032c7d-7294-499c-b985-373d84ca7d42 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1554 microversion: 2.1 time: 0.297985 Aug 17 16:16:50.800194 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 79/154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:50 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1554 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:50.873536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:50.874255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:50.887157 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:50.887794 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:50.888255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:50.888926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:50.889371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:50.890553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:51.110416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:51.118220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-470d3ca0-eefe-41e6-8ea1-c0d4c8666044 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.248546 Aug 17 16:16:51.119181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 76/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:50 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:51.819687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:51.820640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:51.831119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:51.832224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:51.833876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:51.834696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:51.849893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:51.851007 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:52.142786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:52.143653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:52.162994 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:52.163981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:52.165101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:52.167051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:52.168717 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:52.169267 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:52.257352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:52.270300 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-237446f3-1e35-4fc1-802c-6d70ab5276b2 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1554 microversion: 2.1 time: 0.454464 Aug 17 16:16:52.273717 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 80/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:51 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1554 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:52.679427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:52.697853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ac98654b-25ab-4e97-ba2f-ef66e14f1363 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.556584 Aug 17 16:16:52.697853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 77/157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:52 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:53.266358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b", "name": "network-vif-deleted", "tag": "955a4a4d-b6c2-4cea-8684-7339a37cd0a5"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:16:53.281405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:53.282386 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:53.283455 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:53.298627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:53.300255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:53.314258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:53.316063 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:53.317505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:53.318604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:53.320616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:53.322511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:53.353635 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] Creating event network-vif-deleted:955a4a4d-b6c2-4cea-8684-7339a37cd0a5 for instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b on hv-cinder-85220 Aug 17 16:16:53.381804 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-611560b2-344c-4789-a133-94bd2a8625d0 req-214b27aa-00ed-40dc-8032-53162d50618f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132291 Aug 17 16:16:53.398563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 81/158] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:16:53.483847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:53.484493 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c5707db6-45e9-4088-b713-9a1f268da2c5 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1512 microversion: 2.1 time: 0.193096 Aug 17 16:16:53.496936 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 78/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:53 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:53.715157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:53.715885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:53.722420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:53.723111 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:53.723788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:53.724954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:53.725558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:53.726137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:53.978680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:53.986966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c62ce03f-67a0-4991-9b66-2f3f3cbb62cf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.275992 Aug 17 16:16:53.989031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 82/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:53 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:16:54.516677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:54.517882 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:54.524525 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:54.525307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:54.525928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:54.526817 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:54.527477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:54.528769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:54.594216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:54.602505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cbc9fc9d-a1df-4fbf-98ea-01ce941bb182 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1512 microversion: 2.1 time: 0.090120 Aug 17 16:16:54.603310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 79/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:54 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:55.010397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:55.011000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:55.019038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:55.019513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:55.020156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:55.020845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:55.021293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:55.021703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:55.287555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:55.295888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6f20475f-4fca-49e0-8db6-0dc1597a0a1d tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.289168 Aug 17 16:16:55.299510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 83/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:55 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:55.625646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:55.626949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:55.633712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:55.634193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:55.634619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:55.635315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:55.635759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:55.636207 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:55.703404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:55.711963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bef05aa3-659f-4cf3-8ce6-7489f36e6c78 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1346 microversion: 2.1 time: 0.090998 Aug 17 16:16:55.712565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 80/163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:55 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:56.322728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:56.325213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:56.334072 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:56.334654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:56.335156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:56.335890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:56.336496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:56.336922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:56.481525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:56.489029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e0f597e8-4417-4741-a5b6-8feb0b6ca8b8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.170386 Aug 17 16:16:56.489592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 84/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:56 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:56.735321 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:56.735973 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:56.742080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:56.742566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:56.743000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:56.743694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:56.744175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:56.744598 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:56.814780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:56.822745 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a11f5c51-4e10-4103-bb00-99013215e1a7 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1346 microversion: 2.1 time: 0.092122 Aug 17 16:16:56.823316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 81/165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:56 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:57.517209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:57.519641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:57.526956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:57.527669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:57.528472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:57.529596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:57.530272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:57.531268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:57.800133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:57.817784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7ffe956b-43dc-49c1-b1f5-df2e725bd365 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.310476 Aug 17 16:16:57.819814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 85/166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:57 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:57.846056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:57.846725 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:57.859356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:57.860003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:57.860449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:57.861220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:57.862700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:57.863277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:57.901000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:57.901492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:57.901918 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:57.902535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lazy-loading 'fault' on Instance uuid d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:16:57.981706 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2a3a6a0bc461d9e7ba14c8a037b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fef305b90d942ea823ca9ba799bb9af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:57.991734 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b85b7ad4-131b-4df2-bcda-b280348f5619 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 200 len: 1351 microversion: 2.1 time: 0.150424 Aug 17 16:16:57.992356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 82/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:57 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 1351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:16:58.841606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:58.842496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:58.859087 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:58.859756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:58.860481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:58.862888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:58.863429 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:58.865381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:59.023645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:59.025365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:59.036191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:59.036941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:59.037526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:59.038375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:59.038991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:59.039779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:59.057244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] HTTP exception thrown: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Request method failure captured: Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b HTTP/1.1 Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQkCoCZtyZ8qcNYm2zomzok-WNsdDWLja6yVfqbozfymoq25BEnJRdBabZYvlleQcyJP4IZC-tor8LT0OhotCjSSknIHW7o3Z6QfXE3tF4gw3-IaBIztoUBchHb1opFcAPsVKhu750PApnh1gUlYAmVFAmGWYXaqNp5E6Y6mpEcmRU Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:16:59.064538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fef305b90d942ea823ca9ba799bb9af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: d8f2a3a6a0bc461d9e7ba14c8a037b59 Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.066227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'd7e0e662-b455-4dd1-9f6c-df96d5dc5e3b'} Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:16:59.067393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.068740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.070902 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Returning 404 to user: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:16:59.071784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-377fcad4-10d8-40af-b270-9ccbdaf93c6f tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 404 len: 111 microversion: 2.1 time: 0.053182 Aug 17 16:16:59.072360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 83/168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:59 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:16:59.234179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:16:59.236479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:16:59.247725 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:59.248833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:59.249741 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:59.251489 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:16:59.253164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:16:59.253861 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:16:59.273322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] HTTP exception thrown: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Request method failure captured: Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b/os-volume_attachments HTTP/1.1 Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQkCoCZtyZ8qcNYm2zomzok-WNsdDWLja6yVfqbozfymoq25BEnJRdBabZYvlleQcyJP4IZC-tor8LT0OhotCjSSknIHW7o3Z6QfXE3tF4gw3-IaBIztoUBchHb1opFcAPsVKhu750PApnh1gUlYAmVFAmGWYXaqNp5E6Y6mpEcmRU Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:16:59.275287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fef305b90d942ea823ca9ba799bb9af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: d8f2a3a6a0bc461d9e7ba14c8a037b59 Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.276515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'server_id': 'd7e0e662-b455-4dd1-9f6c-df96d5dc5e3b'} Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:16:59.277144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:16:59.278177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:16:59.282272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Returning 404 to user: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:16:59.283442 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-46bbfef7-0213-4aa6-a494-d22d9135c9fc tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066216 Aug 17 16:16:59.285077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 84/169] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:16:59 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:16:59.544086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:16:59.553815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a62447f5-8854-4e35-a756-dc5a5cd42e3a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.717763 Aug 17 16:16:59.561788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 86/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:16:58 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:00.580750 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:00.581348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:00.583448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:00.599058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.600132 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.600652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.601355 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.604426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.605088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.759965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:00.760547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:00.762923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=44 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:00.773670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.774157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.774585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.775284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.775728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.776172 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.823131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] HTTP exception thrown: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Request method failure captured: Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: DELETE /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b HTTP/1.1 Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQkCoCZtyZ8qcNYm2zomzok-WNsdDWLja6yVfqbozfymoq25BEnJRdBabZYvlleQcyJP4IZC-tor8LT0OhotCjSSknIHW7o3Z6QfXE3tF4gw3-IaBIztoUBchHb1opFcAPsVKhu750PApnh1gUlYAmVFAmGWYXaqNp5E6Y6mpEcmRU Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:17:00.872658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fef305b90d942ea823ca9ba799bb9af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: d8f2a3a6a0bc461d9e7ba14c8a037b59 Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.875033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'd7e0e662-b455-4dd1-9f6c-df96d5dc5e3b'} Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:17:00.875845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.877083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:00.882910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Returning 404 to user: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:17:00.884341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f0750540-cd5a-42fe-8c6f-de3ef22630c4 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 404 len: 111 microversion: 2.1 time: 0.128687 Aug 17 16:17:00.891757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 87/171] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:17:00 2022] DELETE /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:17:00.902555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:00.906099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] [instance: d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:00.932925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.933581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.935139 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.939181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:00.940443 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:00.941747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:00.992197 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] HTTP exception thrown: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Request method failure captured: Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b HTTP/1.1 Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQkCoCZtyZ8qcNYm2zomzok-WNsdDWLja6yVfqbozfymoq25BEnJRdBabZYvlleQcyJP4IZC-tor8LT0OhotCjSSknIHW7o3Z6QfXE3tF4gw3-IaBIztoUBchHb1opFcAPsVKhu750PApnh1gUlYAmVFAmGWYXaqNp5E6Y6mpEcmRU Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:17:00.998012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fef305b90d942ea823ca9ba799bb9af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fef305b90d942ea823ca9ba799bb9af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 0fef305b90d942ea823ca9ba799bb9af Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-DeleteServersTestJSON-2006640640 Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: d8f2a3a6a0bc461d9e7ba14c8a037b59 Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-DeleteServersTestJSON-2006640640-project Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:01.000295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'd7e0e662-b455-4dd1-9f6c-df96d5dc5e3b'} Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:17:01.001093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. Aug 17 16:17:01.002357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:17:01.005644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] Returning 404 to user: Instance d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:17:01.007987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f380e73d-a8bb-4f61-bf4a-8e8851999257 tempest-DeleteServersTestJSON-2006640640 tempest-DeleteServersTestJSON-2006640640-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b" status: 404 len: 111 microversion: 2.1 time: 0.114733 Aug 17 16:17:01.010575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 88/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:00 2022] GET /compute/v2.1/servers/d7e0e662-b455-4dd1-9f6c-df96d5dc5e3b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:17:01.775019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:01.793956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c3d89513-9dbd-4b5f-ad98-9a80b2a1c909 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 1.214614 Aug 17 16:17:01.796488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 85/173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:00 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:02.820750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:02.821345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:02.832913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:02.833741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:02.835006 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:02.837875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:02.838525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:02.839107 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:03.245257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:03.266324 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ecc52298-afea-41ab-a418-d71c0ec05e7c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.442932 Aug 17 16:17:03.267267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 89/174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:02 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:04.289686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:04.291446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:04.309653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:04.313017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:04.315647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:04.319439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:04.320135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:04.322348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:04.691935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:04.700940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b581a7d3-64dd-4dc4-86a3-88b45419a8fa tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.416402 Aug 17 16:17:04.703739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 86/175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:04 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:05.733989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:05.735185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:05.747101 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:05.747987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:05.748819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:05.750326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:05.752925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:05.754060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:06.096052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:06.109829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-42a03702-807d-4fff-958c-0cfa838f4cff tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.380212 Aug 17 16:17:06.113576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 90/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:05 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:07.134154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:07.135583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:07.147083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:07.154906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:07.156177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:07.157730 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:07.162831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:07.163285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:08.340317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:08.351265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ac5cb8be-98ac-4b96-9398-44a2797c5f0f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 1.221937 Aug 17 16:17:08.363719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 87/177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:07 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:09.413198 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:09.414926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:09.441646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:09.443572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:09.444322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:09.447869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:09.449367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:09.450268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:10.015832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:10.026290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-594a1d47-54ce-4ed5-af65-b99d6daaf108 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.642415 Aug 17 16:17:10.031249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:09 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:11.059732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:11.063611 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:11.083183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:11.085506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:11.086187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:11.087480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:11.090678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:11.091404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:11.662202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:11.671641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-08941555-08d3-4067-8dd3-ffdbf8951f11 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.623252 Aug 17 16:17:11.672335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 88/179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:11 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:12.696373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:12.698454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:12.714871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:12.716082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:12.718996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:12.721670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:12.724329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:12.726882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:12.986835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:12.999662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8a05fe66-a5f2-4302-a94b-5ec3f1cf4920 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.308233 Aug 17 16:17:13.000528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 92/180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:12 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:14.024986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:14.025649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:14.033484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:14.034256 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:14.034845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:14.036027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:14.039156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:14.040234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:14.268240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:14.281086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-410ed913-be32-4662-b60d-37579ac932d1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.261010 Aug 17 16:17:14.284008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 89/181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:14 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:14.736502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e803dd6e-bc3b-41f6-a66b-fb649734f4fd tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eeae0fd30>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:14.789355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e803dd6e-bc3b-41f6-a66b-fb649734f4fd tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e811528c-7d29-4f64-866e-db58e641bcce" status: 200 len: 351 microversion: 2.1 time: 0.057387 Aug 17 16:17:14.800171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 93/182] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:17:14 2022] GET /compute/v2.1/os-volumes/e811528c-7d29-4f64-866e-db58e641bcce => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:15.305573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:15.314899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:15.322507 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:15.323193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:15.323852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:15.325109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:15.325751 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:15.326456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:15.516379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:15.526848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-de995e48-f5ad-4427-9967-17e7b368cb71 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.224131 Aug 17 16:17:15.527795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 90/183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:15 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:16.549532 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:16.550200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:16.557333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:16.558169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:16.558590 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:16.559566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:16.560040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:16.560976 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:16.728447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:16.739519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6eaa6265-395a-43c3-aa02-1a524519c116 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.194656 Aug 17 16:17:16.740482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 94/184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:16 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:17.762864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:17.764928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:17.774274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:17.774780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:17.775579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:17.776322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:17.777503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:17.778032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:17.969618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:17.977947 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1006909d-cdd0-498b-bcc5-dfac86200145 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.218768 Aug 17 16:17:17.980037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 91/185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:17 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:18.382316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3d755c1d-2961-4cba-bd1e-c52529ebb33b tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eeaec7c10>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:18.472082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3d755c1d-2961-4cba-bd1e-c52529ebb33b tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/fa73414e-f1e9-498a-a1dd-5a1fc5ea7e00" status: 200 len: 350 microversion: 2.1 time: 0.093742 Aug 17 16:17:18.473991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 95/186] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:17:18 2022] GET /compute/v2.1/os-volumes/fa73414e-f1e9-498a-a1dd-5a1fc5ea7e00 => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:18.757182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1132105389", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:18.856446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] validate_networks() for None {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:17:18.999391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:19.001733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:19.016905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:19.017396 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:19.017833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:19.018535 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:19.018982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:19.019410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:19.022267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=89 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:19.317285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:19.325261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6040f058-8056-4928-b659-8ba159f7e321 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.330183 Aug 17 16:17:19.327636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 96/187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:18 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:19.385272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:17:19.385698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:17:19.386166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:17:19.386572 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:17:19.387001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:17:19.406976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:19.407675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:19.408776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:19.411669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:19.412333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:19.412926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:19.433352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Getting quotas for project e49ba29c576d4a40a591668c4c304aab. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:17:19.438253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Getting quotas for user faff5534c95e49e18f14d69654fb4996 and project e49ba29c576d4a40a591668c4c304aab. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:17:19.455452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:17:19.458530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:17:19.524411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-20e836f8-d2d6-47cd-b2ca-0ed9a1d53d2b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772277 Aug 17 16:17:19.525059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 92/188] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:17:19.537692 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-12b3b213-1914-4359-af3a-0bc5dc8b3bf0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:19.538892 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-12b3b213-1914-4359-af3a-0bc5dc8b3bf0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:19.654789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-12b3b213-1914-4359-af3a-0bc5dc8b3bf0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:19.664232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-12b3b213-1914-4359-af3a-0bc5dc8b3bf0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1215 microversion: 2.1 time: 0.130300 Aug 17 16:17:19.664357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 97/189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:19 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:20.217427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-53eb2736-0acd-4854-8f9a-547e74848c21 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea6d5ee0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:20.379123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:20.379841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:20.391364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:20.392008 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:20.392524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:20.393401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:20.393911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:20.394882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:20.496625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-53eb2736-0acd-4854-8f9a-547e74848c21 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/371c26a4-e792-49d5-9d10-4d87f5539d7f" status: 200 len: 351 microversion: 2.1 time: 0.284297 Aug 17 16:17:20.497568 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 93/190] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/os-volumes/371c26a4-e792-49d5-9d10-4d87f5539d7f => generated 351 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:20.511678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ad6e29ed-89cd-419c-b99b-9dd70c17f5aa tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea4bfe50>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:20.722619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:20.731511 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6e4d23f7-6a2a-40ea-a832-78978446a663 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.368456 Aug 17 16:17:20.737016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 98/191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:20.742910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:20.743745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:20.766604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:20.768129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:20.768722 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:20.770356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ad6e29ed-89cd-419c-b99b-9dd70c17f5aa tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.262181 Aug 17 16:17:20.770849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:20.773697 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:20.773854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 94/192] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:20.774418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:20.797588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6fee1fe0-9f63-4302-a4ba-a0e528598a0a tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea4bfc10>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:20.894664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:20.913188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-db3a964a-46f2-4ad0-98c7-c773427c8be1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1267 microversion: 2.1 time: 0.165951 Aug 17 16:17:20.918566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 99/193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:20.968537 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6fee1fe0-9f63-4302-a4ba-a0e528598a0a tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185931 Aug 17 16:17:20.969297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 95/194] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:20.992263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-35f533dd-9a66-41e2-bc5d-7fd3a86dcffd tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eeae6eb80>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.194040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-35f533dd-9a66-41e2-bc5d-7fd3a86dcffd tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.209836 Aug 17 16:17:21.195512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 100/195] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 17 16:17:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:21.210373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c4129633-078f-431f-846b-e28e211cfdc9 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea45b430>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.330476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c4129633-078f-431f-846b-e28e211cfdc9 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122726 Aug 17 16:17:21.331754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 96/196] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:21.348115 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3526e73d-e7a1-4dea-a56f-572ffa1e8ce0 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eead43dc0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.515276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3526e73d-e7a1-4dea-a56f-572ffa1e8ce0 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.173003 Aug 17 16:17:21.517278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 101/197] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:21.532233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b84107ff-6df0-4ad5-9c6d-ba054a5c59ac tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea472940>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.637938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-710256d3-fd20-4d63-891a-e67f5a2ea667 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'create', calling method: .version_select at 0x7f9eead11f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-433260614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObuWXF4G9Xn7nQWASDZeX+iu9dNUQG80cVsJAWM+T1lzYvZDgph8wxNuMxaiK99OrFqOGPu3rLCrz3cJUMTgjpmfq1RXvpZRKWSDI21qjtdvXE7XlYalezLwI4yjUWROw=="}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:21.678462 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-710256d3-fd20-4d63-891a-e67f5a2ea667 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Getting quotas for project c73a224fc7784fd6876e81a0e7097127. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:17:21.689802 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-710256d3-fd20-4d63-891a-e67f5a2ea667 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Getting quotas for user 388379cb8722477fbba3162dcbe3cc8a and project c73a224fc7784fd6876e81a0e7097127. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:17:21.710538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b84107ff-6df0-4ad5-9c6d-ba054a5c59ac tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.182956 Aug 17 16:17:21.712304 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 97/198] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:21.730627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-efe83bfb-1a4d-416b-adda-d9bdbef9c0ff tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea45bca0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.768726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-710256d3-fd20-4d63-891a-e67f5a2ea667 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.143258 Aug 17 16:17:21.769242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 102/199] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:17:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:21.774371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.774977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:21.783408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:21.784214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:21.785527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:21.786412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:21.787021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:21.788151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:21.870006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-efe83bfb-1a4d-416b-adda-d9bdbef9c0ff tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.144573 Aug 17 16:17:21.871173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 98/200] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:21.891842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c7a36b75-a85e-47e0-9630-f9e9032c5131 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] Calling method '.version_select at 0x7f9eea4728b0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:21.979157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:21.990235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8ef096c2-3936-4244-908e-f6692409e7c2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.219572 Aug 17 16:17:22.003832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 103/201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:22.003832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1927902343", "imageRef": "f54f0db2-8e8f-4ce4-b245-00461ffbb35a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-433260614", "networks": [{"uuid": "4ecf7abe-7c31-4831-8ddc-32819d5db98d"}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:22.020117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c7a36b75-a85e-47e0-9630-f9e9032c5131 tempest-VolumesTestJSON-1517917329 tempest-VolumesTestJSON-1517917329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.136562 Aug 17 16:17:22.020773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 99/202] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 17 16:17:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:22.025739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:22.026345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:22.034785 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:22.036104 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:22.036548 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:22.038264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:22.039017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:22.039451 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:22.044078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=97 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:22.065517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] validate_networks() for [('4ecf7abe-7c31-4831-8ddc-32819d5db98d', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:17:22.117829 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:22.130104 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fba5e3b8-25aa-496a-8a5e-11928dbbaf74 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1273 microversion: 2.1 time: 0.107946 Aug 17 16:17:22.130888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 100/203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:22 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:22.765039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:17:22.765480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:17:22.765948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:17:22.766350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:17:22.766755 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:17:22.779267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:22.780181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:22.780613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:22.781325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:22.781774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:22.782186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:22.803051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Getting quotas for project c73a224fc7784fd6876e81a0e7097127. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:17:22.829543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Getting quotas for user 388379cb8722477fbba3162dcbe3cc8a and project c73a224fc7784fd6876e81a0e7097127. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:17:22.863719 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:17:22.868681 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f54f0db2-8e8f-4ce4-b245-00461ffbb35a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:17:22.949222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2ede6772-ae6d-4deb-b14b-ee35b36caec6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956436 Aug 17 16:17:22.956215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 104/204] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:17:22.963919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cf571231-f58a-4783-9926-f76feeef38e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:22.964636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cf571231-f58a-4783-9926-f76feeef38e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:23.027337 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:23.030310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:23.043700 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:23.045326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:23.046899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:23.049366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:23.050554 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:23.052224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:23.141157 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cf571231-f58a-4783-9926-f76feeef38e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:23.150008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cf571231-f58a-4783-9926-f76feeef38e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1258 microversion: 2.1 time: 0.192301 Aug 17 16:17:23.150784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 101/205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:22 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:23.160869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:23.162926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:23.176195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:23.179131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:23.180615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:23.181677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:23.182940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:23.190663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:23.291457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:23.301312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0629683f-d16c-426c-8254-e0db57220e5b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1520 microversion: 2.1 time: 0.281112 Aug 17 16:17:23.302311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 105/206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:23 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:23.303510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:23.315340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3ee9f3fd-c841-44d3-b7f2-e913d83796e3 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1273 microversion: 2.1 time: 0.163704 Aug 17 16:17:23.332408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 102/207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:23 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:24.171358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:24.173514 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:24.181454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.182250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.182970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.184185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.184771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.185752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.300649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:24.309135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ed4a8774-36fb-4a77-8ca4-d6ed5848409e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1310 microversion: 2.1 time: 0.142015 Aug 17 16:17:24.309872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 106/208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:24 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1310 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:24.322363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:24.323677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:24.331059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.331937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.332719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.334032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.334808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.335487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.339727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:24.340368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:24.352063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.352600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.353159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.354126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.354720 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.355283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.582189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:24.591433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3d0ac424-a375-481c-b290-a11cdbc46dc1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1500 microversion: 2.1 time: 0.272666 Aug 17 16:17:24.610175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 103/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:24 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:24.616556 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:24.617379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:24.641742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.644187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.644561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.648364 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.649435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.650214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.680875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:24.690549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-36085921-790d-4cce-a397-ca34e7dd9154 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.355758 Aug 17 16:17:24.706890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 107/210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:24 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:24.845133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a256d7e0-505d-4b06-8672-c5075f5d182a", "tag": "db2ccf50-a124-4554-b2ca-dcf4abd7ef47"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:24.874651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:24.875542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:24.878773 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:24.916861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] Creating event network-changed:db2ccf50-a124-4554-b2ca-dcf4abd7ef47 for instance a256d7e0-505d-4b06-8672-c5075f5d182a on hv-cinder-85220 Aug 17 16:17:24.929751 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-a7501c7e-38be-4489-bc21-6e8d65b079fc req-6d0d5a2e-c225-4a0a-9eef-e2bc0137f66f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106507 Aug 17 16:17:24.932873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:24.943215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b9a55b67-b8a7-4d19-a4fc-2ec4d0c557fc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1516 microversion: 2.1 time: 0.331114 Aug 17 16:17:24.943797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 104/211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:24 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:24.969876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 108/212] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:25.332570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:25.334106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:25.345986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:25.346820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:25.347930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:25.350965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:25.353253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:25.354088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:25.495295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:25.506664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-47fec83a-7770-4942-b566-1d56129326c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1310 microversion: 2.1 time: 0.178517 Aug 17 16:17:25.507770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 105/213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:25 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:25.714249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:25.714931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:25.721985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:25.722453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:25.723106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:25.723875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:25.724585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:25.724999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:25.890408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:25.899220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fdaa54b2-a9d0-42ab-9d37-961ff5751be8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.189639 Aug 17 16:17:25.900099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 109/214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:25 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:26.532511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:26.533948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:26.542588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:26.546480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:26.547167 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:26.548381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:26.549035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:26.549655 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:26.639342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:26.647131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c86e4412-3780-403d-9059-b4ba2314de1e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1318 microversion: 2.1 time: 0.121433 Aug 17 16:17:26.647620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 106/215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:26 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:26.921013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:26.921632 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:26.928530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:26.929016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:26.929445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:26.930141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:26.930588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:26.931005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:27.087175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:27.095781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d2918556-6372-479a-b6b5-6791131e71a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.179393 Aug 17 16:17:27.096393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 110/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:26 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:27.668828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:27.670360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:27.678059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:27.678801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:27.680054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:27.681048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:27.681930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:27.682655 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:27.759485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:27.771165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5b23a599-f6e8-4fd6-8cf5-bb00639de03f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1318 microversion: 2.1 time: 0.106251 Aug 17 16:17:27.772158 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 107/217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:27 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:28.117370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:28.118148 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:28.132629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.135761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.136478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.137568 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.138709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.140564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.505633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:28.521498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1018f0c7-1ff9-4bf4-9c0e-cdd91b6a72d9 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.408113 Aug 17 16:17:28.522916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 111/218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:28 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:28.706964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:28.709330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:28.719659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.720176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.720814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.722856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.725126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.726565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.770523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lazy-loading 'flavor' on Instance uuid 153d19a6-a000-4320-8e36-d1528026298f {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:17:28.793555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:28.794721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:28.805103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.806218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.812724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.816220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.816863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.817437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.926449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a8674106-7bbb-4217-9d50-1fe950ebcb3f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/action" status: 200 len: 32 microversion: 2.1 time: 0.223790 Aug 17 16:17:28.931896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 108/219] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:17:28 2022] POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:17:28.940390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:28.941165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:28.956539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.957202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.957548 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:28.958414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:28.958912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:28.959528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:29.072221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:29.087526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b51e65f6-219c-4b12-b3e1-5b11a62caa96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1316 microversion: 2.1 time: 0.297828 Aug 17 16:17:29.088234 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 112/220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:28 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:29.264326 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:29.274396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-81cf7c8d-132d-42ba-bc9b-f6dc010e5341 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.340318 Aug 17 16:17:29.275211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 109/221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:28 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:29.546631 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:29.547266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:29.569138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:29.572112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:29.622686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:29.630682 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:29.638974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:29.650958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:29.873940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:29.881601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-898798f9-d41f-492f-914e-68b119aa26e1 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.341729 Aug 17 16:17:29.882112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 113/222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:29 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:30.112752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:30.113351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:30.115456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.121080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.121647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.122093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.123613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.124144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.124517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.297415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:30.298142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:30.304437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.304992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.305489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.306178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.306624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.307040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.330907 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:30.339837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-906e72cf-53a1-4c81-a646-30f797ab8dc2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.230830 Aug 17 16:17:30.340700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 110/223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:30 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:30.462344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:30.475626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6e7ec6fc-e5a2-40f4-b449-c9b2cc269152 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.182556 Aug 17 16:17:30.476586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 114/224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:30 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:30.571621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:30.572713 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:30.585230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.586004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.595197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.596131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.596613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.597139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.625115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2fd5d923-3df9-4bcf-a6fd-4bf8f3709b51 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/ips" status: 200 len: 152 microversion: 2.20 time: 0.059083 Aug 17 16:17:30.625798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 111/225] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 17 16:17:30 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/ips => generated 152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:17:30.904585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:30.905265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:30.907844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.915792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.916414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.916935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:30.917860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:30.918509 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:30.918931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:31.082977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:31.093846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ea8e7c4e-a20a-49f4-a454-07fca25d1096 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.194744 Aug 17 16:17:31.094534 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 115/226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:30 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:31.365540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:31.366148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:31.368192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:31.374337 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:31.374840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:31.375302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:31.376126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:31.376747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:31.377171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:31.502512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:31.503401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:31.509746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:31.510262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:31.510696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:31.511395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:31.511881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:31.512505 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:31.631215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:31.646691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0d2e7852-697b-499b-aa6f-8a2d2a9022d4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.284739 Aug 17 16:17:31.653503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 112/227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:31 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:31.741312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:31.745780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0de52a6c-49d9-4ccb-81f3-08cf076227e0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.248737 Aug 17 16:17:31.746530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 116/228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:31 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:32.114546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:32.116428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:32.123916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.124655 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.125685 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.126983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.127118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.127767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.358889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:32.367917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-abcd64b6-dafd-487d-888d-ae4390941c79 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.256983 Aug 17 16:17:32.380719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 113/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:32 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:32.671405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:32.672050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:32.678673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.679156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.679586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.680312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.680881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.681305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.766652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:32.767479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:32.776166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.776652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.777083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.777777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:32.778226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:32.778758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:32.790586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.852158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=12 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.865350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:32.875578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-55c04f0e-5ca2-48bb-9418-a765973f9144 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.209600 Aug 17 16:17:32.876960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 117/230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:32 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:33.145035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=8 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:33.161626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:33.180263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c6bb1f65-40fc-4439-80fd-1bd0b697a00e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.409154 Aug 17 16:17:33.180959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 114/231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:32 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:33.392764 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:33.393372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:33.410634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:33.411405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:33.412078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:33.412927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:33.417369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:33.418029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:33.429182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:33.659128 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:33.667455 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-78b45fe7-cec7-48bf-96f4-7a3d834452a8 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.281322 Aug 17 16:17:33.680580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 118/232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:33 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:33.897003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:33.898463 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:33.906230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:33.907003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:33.907448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:33.908176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:33.908630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:33.909047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:34.049921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:34.057366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-25cf29a1-321d-4dad-afb8-3bd5c492f187 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.164382 Aug 17 16:17:34.057931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 115/233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:33 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:34.216676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:34.218264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:34.228166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:34.228880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:34.229460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:34.230620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:34.231683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:34.232756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:34.524558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:34.535140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5b0e71a2-6aa5-4d62-8733-e2ad8dbbd30f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.334706 Aug 17 16:17:34.535854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 119/234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:34 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:34.691354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:34.691988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:34.698140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:34.698605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:34.699034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:34.699715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:34.700830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:34.701271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:34.705225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:34.895159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:34.905770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a4c71658-f13d-4c83-b4ff-0de3a755f0fe tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.217820 Aug 17 16:17:34.907226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 116/235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:34 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:35.078797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:35.079404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:35.090833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.095948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.096435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:35.097296 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.097926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.098359 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:35.258520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:35.266102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-59987734-1ce0-49aa-abc1-e82fe88e0d4d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.191677 Aug 17 16:17:35.266790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 120/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:35 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:35.558659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:35.559340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:35.565403 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.565946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.566380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:35.567058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.567504 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.567962 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:35.740906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:35.749582 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-71df5603-dc1c-4072-8d04-d86a96020470 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.194652 Aug 17 16:17:35.752205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 117/237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:35 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:35.935390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:35.936335 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:35.943043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.943531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.944010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:35.944703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:35.945153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:35.945565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:36.102133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:36.113419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-99a5ed17-464c-46c3-96ae-74c78ac49699 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.182061 Aug 17 16:17:36.125197 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 121/238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:35 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:36.288649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:36.289946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:36.296313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:36.296800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:36.297232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:36.297934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:36.298453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:36.299083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:36.525220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:36.538645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c77bd0d9-da2a-4d00-a94e-7f4e54abf294 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.254177 Aug 17 16:17:36.539406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 118/239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:36 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:36.775231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:36.776412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:36.788572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:36.789336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:36.789953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:36.790844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:36.791453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:36.792389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:37.023409 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:37.032357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-31549b75-4145-4732-86da-a807fd44d544 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.263005 Aug 17 16:17:37.033487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 122/240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:36 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:37.135758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:37.136581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:37.148336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:37.149122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:37.149562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:37.150273 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:37.153363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:37.153984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:37.377431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:37.386090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1ab30285-f8a1-426e-8cb9-e84f76ca8dd6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.254501 Aug 17 16:17:37.386675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 119/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:37 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:37.566676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:37.567295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:37.578434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:37.579160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:37.579841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:37.580710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:37.581171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:37.581600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:37.759928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:37.769771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ae90498c-1590-433d-b279-b9a73715a183 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.207342 Aug 17 16:17:37.770379 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 123/242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:37 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:38.055540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:38.057128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:38.065090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.065676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.066411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.067214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.068067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.068688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.110064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:38.119199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:38.138552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.141701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.142207 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.143092 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.143491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.143933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.232185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lazy-loading 'flavor' on Instance uuid 25fb5ec0-85bf-4268-a9ab-3d0f89924363 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:17:38.291022 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:38.301836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c3ee4fbc-783a-4730-a7bd-2d7b12f93067 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.251387 Aug 17 16:17:38.302761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 120/243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:38 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:38.362316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a256d7e0-505d-4b06-8672-c5075f5d182a", "name": "network-vif-plugged", "status": "completed", "tag": "db2ccf50-a124-4554-b2ca-dcf4abd7ef47"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:38.382264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.394743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.407388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.425124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] Creating event network-vif-plugged:db2ccf50-a124-4554-b2ca-dcf4abd7ef47 for instance a256d7e0-505d-4b06-8672-c5075f5d182a on hv-cinder-85220 Aug 17 16:17:38.442607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-529b9c59-607b-4c05-aa34-a74a13ac8c31 req-c5a2a3a3-6ad9-404e-876d-6c6d748bcfa0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087107 Aug 17 16:17:38.443371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 121/244] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:17:38.458213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:38.459317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:38.481189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.485433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.486075 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.486867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.489112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.490025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.758874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:38.773098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-dc88b639-928b-4bd9-b9a6-ce8c55c1beda tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.324474 Aug 17 16:17:38.774539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:38 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:38.791825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:38.794815 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:38.817853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.818474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.819080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.819880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.820405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.820923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.836255 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-15d1ff3e-6f7d-4258-98fe-f0953dd9219e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/action" status: 202 len: 0 microversion: 2.20 time: 0.735544 Aug 17 16:17:38.844954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 124/246] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 17 16:17:38 2022] POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:17:38.853919 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:38.860944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:38.878823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.879577 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.880229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:38.881119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:38.881748 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:38.882366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:39.020184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:39.034588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-aedd3115-17b2-4ad2-b0a3-0ad99de27343 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.247625 Aug 17 16:17:39.035543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 123/247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:38 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:39.177084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:39.186696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:39.188683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:39.190025 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b34c2084-19e9-4903-bfae-477b856946c4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.340580 Aug 17 16:17:39.191057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 125/248] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:38 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:39.326859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:39.327462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:39.334229 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:39.335043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:39.335690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:39.336661 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:39.337270 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:39.337954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:39.602264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:39.633173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cefab95e-d896-4202-bf4c-47ec974a6c1b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.308691 Aug 17 16:17:39.648253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 124/249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:39 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:39.800141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:39.800141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:39.803368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:39.804066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:39.804733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:39.805609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:39.806604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:39.807256 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.058190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:40.058809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:40.069469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.072394 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.073061 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.076013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.082498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.083563 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.253026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.266176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7c16356c-717e-4967-965b-cf05f5559996 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.475119 Aug 17 16:17:40.273213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.282404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b52a570c-d7e9-4497-8423-37e8b3e989c4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.228626 Aug 17 16:17:40.283978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 126/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:39 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:40.295531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:40.296947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:40.303735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.304461 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.305050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.305919 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.306684 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.307114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.310294 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 125/251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:40 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:40.514850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.523182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.524728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.525955 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8e6b195d-a6a3-49e2-a07a-c815d1428e98 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.240546 Aug 17 16:17:40.526475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 127/252] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:40 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:40.658588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:40.659612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:40.666749 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.667439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.667935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.668845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:40.669566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:40.670263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:40.822732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:40.835039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c5b95343-b6cd-4272-a7f3-cb91f53a1d78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.181349 Aug 17 16:17:40.836864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 126/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:40 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:41.290761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:41.291363 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:41.299856 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.301337 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.301899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.302614 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.303067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.303478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.315038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:41.316004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:41.322273 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.322758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.323186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.323897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.324510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.326108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.514270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:41.522875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-069ddd97-4f02-44e1-978c-e77c205676a0 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.235837 Aug 17 16:17:41.524065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 128/254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:41 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:41.559617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:41.561429 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:41.567896 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.568618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.569823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.570714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.571313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.571935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.686572 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:41.695741 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ef996a5c-10a0-440d-89ab-b1bcf4f19276 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.384455 Aug 17 16:17:41.706690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 127/255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:41 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:41.773489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:41.786891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:41.789119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:41.791427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6015ef4b-988a-4601-ac0e-ed23943e38ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.235694 Aug 17 16:17:41.792785 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 129/256] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:41 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:41.858318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:41.859371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:41.866070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.866797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.867452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:41.875503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:41.876491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:41.878641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:42.145261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:42.154559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b7609b1e-71c3-46ff-80d5-01c9202aa1a3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.300576 Aug 17 16:17:42.155139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 128/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:41 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:42.545998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:42.546674 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:42.553316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:42.553918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:42.554452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:42.555373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:42.555932 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:42.556410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:42.727549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:42.728209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:42.751044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:42.754216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:42.755627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:42.758662 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:42.759304 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:42.760066 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:42.947557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:42.960527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4de8d8a5-1873-4840-a51b-8c0292a12be7 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.418826 Aug 17 16:17:42.962166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 130/258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:42 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:42.983792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:42.984513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:43.000189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.001025 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.001685 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:43.002588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.003996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.004652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:43.242605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:43.247834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:43.255260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a6cca1a5-4103-47c9-b65c-88cee34da567 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.540478 Aug 17 16:17:43.260377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 129/259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:42 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:43.266433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:43.268672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:43.270097 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-516d1c43-d55c-4f1d-8d9e-77adc64b137e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.306365 Aug 17 16:17:43.270643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 131/260] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:42 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:43.272057 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:43.272660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:43.279594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.280136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.280565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:43.281252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.281699 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.282108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:43.472457 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:43.481028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8531542e-7ac6-4742-a73f-4028ae53dca1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.219388 Aug 17 16:17:43.482265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 130/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:43 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:43.983565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:43.984197 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:43.991451 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.992059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.992525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:43.993264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:43.993716 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:43.994134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.279145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:44.280561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:44.286964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.289141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.289652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.290528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.291226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.291657 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.325752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.328106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:44.339841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1bf4c924-f830-481c-b7a7-1dbc63a617bf tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.360578 Aug 17 16:17:44.354322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 132/262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:43 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:44.363200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:44.364167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:44.400450 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.401188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.401834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.403599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.404243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.404817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.544388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.558474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d8a2018f-a488-49fb-9a41-f7e92b3f03e1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.283237 Aug 17 16:17:44.560507 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 131/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:44 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:44.568402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:44.569288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:44.602391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.603260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.603718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.604582 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:44.605046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:44.605913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:44.805047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.820000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-87a8a94b-099f-4d7d-975f-2c8d34d53d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.257847 Aug 17 16:17:44.822158 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 132/264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:44 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:44.874385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.883566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.885692 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:44.887320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fdf07957-509b-4498-b2c7-3786b195745e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.531735 Aug 17 16:17:44.887997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 133/265] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:44 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:45.374306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:45.375265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:45.381418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.381967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.382584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.383276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.383728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.384172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.401030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:45.548166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:45.557869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5c509eb0-0b67-4e1c-9c48-fd1fac61a53b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1315 microversion: 2.1 time: 0.187942 Aug 17 16:17:45.558684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 133/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:45 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:45.561125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:45.577820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.578155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.578581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.580902 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:45.581574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:45.588693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.589179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.589613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.590312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.590884 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.591307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.606723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] Creating event network-changed:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:17:45.624058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-a61b128e-0771-4362-a6f4-161bfa502a1f req-43b2564d-282f-4f34-8b18-81263b1c4631 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068547 Aug 17 16:17:45.626067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 134/267] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:17:45.743640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:45.753033 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a2cd1045-093a-4b54-8e66-8a871ddd69e2 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.176097 Aug 17 16:17:45.755834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 134/268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:45 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:45.845230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:45.846008 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:45.861125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.861819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.862387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.863124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.863828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.864369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.911531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:45.912330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:45.925311 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.925854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.926295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:45.927026 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:45.928748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:45.931773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.154517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.167483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.171549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.172384 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.174258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5c5bbae9-7a57-4ff9-b9d7-b611aece9737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.266739 Aug 17 16:17:46.175002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 135/269] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:45 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:46.192224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-029fbb48-1e4d-4afe-a8f0-1bd683869413 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.348500 Aug 17 16:17:46.192224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 135/270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:45 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:46.242931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-509331294", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "networks": [{"uuid": "475d4777-9f80-4e6c-bdd3-d3040fe7dc81"}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:46.298421 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] validate_networks() for [('475d4777-9f80-4e6c-bdd3-d3040fe7dc81', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:17:46.581240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:46.581848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:46.588380 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.588852 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.589276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.589986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.590482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.590897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.651691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:17:46.652519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:17:46.653052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:17:46.653519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:17:46.653927 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:17:46.662589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.663069 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.663492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.664241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.664692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.665110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.684966 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Getting quotas for project 07cd27d906cc4496bdeaf929ff4ec21e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:17:46.689387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Getting quotas for user f945c8c54cb14c0da00b647663278410 and project 07cd27d906cc4496bdeaf929ff4ec21e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:17:46.701285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:17:46.703549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:17:46.725950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.734000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9d1a67ba-a6ce-4ba0-9095-a6c2c8209dab tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1464 microversion: 2.1 time: 0.156531 Aug 17 16:17:46.734563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 136/271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:46 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:46.768973 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6a9ffa27-5c75-4e6c-9e60-ca20b4e06700 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529766 Aug 17 16:17:46.775262 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 136/272] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:17:46.784748 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-71382d46-5102-4daa-890b-5cfd35b6f358 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:46.787190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-71382d46-5102-4daa-890b-5cfd35b6f358 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:46.807856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:46.808742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:46.818218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.818791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.819276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.820207 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.820883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.821301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.849754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:17:46.872801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-71382d46-5102-4daa-890b-5cfd35b6f358 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:46.882938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-71382d46-5102-4daa-890b-5cfd35b6f358 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1213 microversion: 2.1 time: 0.103708 Aug 17 16:17:46.897808 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:46 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:46.906298 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:46.907052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:46.914868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.916308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.916958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.918989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.919634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.920310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.967223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b9dbd63f-bfc6-486c-9399-f488a0c0908e tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 204 len: 0 microversion: 2.1 time: 0.163847 Aug 17 16:17:46.968045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 137/274] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:17:46 2022] DELETE /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:17:46.984263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:46.986823 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:46.992781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.993332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.994554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:46.995313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:46.995850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:46.996336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.164202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.174254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8bec1e75-bd29-4391-89eb-6c661d0d2c3b tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1470 microversion: 2.1 time: 0.197110 Aug 17 16:17:47.176317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 138/275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:46 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:47.186991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.198235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-74c0b74c-8604-44ef-aa21-c8d9334d80b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.299181 Aug 17 16:17:47.198826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 138/276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:46 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:47.220099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:47.220784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:47.221747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:47.223135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:47.229542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.230253 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.230933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.232504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.233202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.233829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.236480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.237184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.237759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.238467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.238926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.239352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.432607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.445011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e0fd9245-b0d9-41b6-8fae-8c13150638a5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.230703 Aug 17 16:17:47.448492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.456309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 139/277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:47 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:47.458053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.460363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.461571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-58349bd3-fbad-4d0e-8514-8d519f97f9e7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.258461 Aug 17 16:17:47.462398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 139/278] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:47 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:47.908325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:47.908902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:47.915651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.916122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.916561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.917254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:47.917734 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:47.918183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:47.978563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:47.986576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8f7a25e4-3651-4631-9241-3bcc57e2b9b5 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1217 microversion: 2.1 time: 0.082156 Aug 17 16:17:47.987133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 140/279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:47 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:48.196839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:48.197502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:48.204115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.204723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.205244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.206150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.206607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.207030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.220349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:48.221335 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:48.228288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.228761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.229188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.229870 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.230479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.230924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.346974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.354807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5533e940-d7c5-4f79-a139-f53d5e346721 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1470 microversion: 2.1 time: 0.162472 Aug 17 16:17:48.355388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 140/280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:48 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:48.372513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.379946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ed983edc-fdf4-419a-a86d-c47b738c5d7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.163441 Aug 17 16:17:48.380503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 141/281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:48 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:48.467194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:48.468010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:48.474397 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.474947 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.475464 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.476247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.476769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.477246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.485097 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:48.486016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:48.492181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.492735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.493240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.494001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:48.494526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:48.495015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:48.677417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.696626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-697093c3-8f2e-4503-8cff-059becd6f17e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.234003 Aug 17 16:17:48.697667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 141/282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:48 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:48.756780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.765144 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.766678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:48.767866 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f13fd3dc-492d-4c0b-8a9e-c490f3941903 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.286754 Aug 17 16:17:48.768423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 142/283] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:48 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:49.008241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:49.009052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:49.015428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.016029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.016527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.017280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.017798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.018285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.092802 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:49.100485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3c14eccd-9472-42b5-afc6-f333d634210a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1265 microversion: 2.1 time: 0.096319 Aug 17 16:17:49.101164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 142/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:49 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:49.365805 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a256d7e0-505d-4b06-8672-c5075f5d182a", "name": "network-vif-deleted", "tag": "db2ccf50-a124-4554-b2ca-dcf4abd7ef47"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:49.386001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:49.388059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:49.399625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.400385 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.403737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.404455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.405171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.405790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.406368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.414590 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.415299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.440453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] Creating event network-vif-deleted:db2ccf50-a124-4554-b2ca-dcf4abd7ef47 for instance a256d7e0-505d-4b06-8672-c5075f5d182a on hv-cinder-85220 Aug 17 16:17:49.451395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-8ed3b77f-e53e-4fe2-b02a-a6384a9bcc13 req-4b974d1e-ec58-4cfd-8bf8-ff511907b5d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089061 Aug 17 16:17:49.452100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 143/285] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:49.466065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:49.484247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:49.494248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.494983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.495745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.498067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.498800 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.499421 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.586822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:49.600645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-42c5e2a6-1048-436e-8b1c-8a86495509a6 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1300 microversion: 2.1 time: 0.227629 Aug 17 16:17:49.611843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 143/286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:49 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:49.719432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:49.721617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:49.728886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.729367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.729801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.730498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.731008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.731434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.799283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:49.807502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-43d76d37-52b1-4ec4-a92f-0049ca46a104 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.346154 Aug 17 16:17:49.808117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 144/287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:49 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:49.820014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:49.820014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:49.836270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.837447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.838373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:49.839399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:49.840323 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:49.841071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.288171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.294310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.299448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e1239a19-225b-4a26-b0d6-7d84a6b7bfc8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.584529 Aug 17 16:17:50.300813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:49 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:50.315375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.319279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.322632 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:50.323575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:50.324763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cd72f8c8-ae9f-4570-b478-64c923333472 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.513454 Aug 17 16:17:50.325741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 145/289] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:49 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:50.332182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.333614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.334530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.335527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.336356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.337013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.424757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.432425 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-525a4054-d7af-4003-a841-a11ce179b8a1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1271 microversion: 2.1 time: 0.121565 Aug 17 16:17:50.433369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 145/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:50 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:50.626550 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:50.627861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:50.635609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.636312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.636909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.638307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.639099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.639518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.686617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.687104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.687678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.688166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lazy-loading 'fault' on Instance uuid a256d7e0-505d-4b06-8672-c5075f5d182a {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:17:50.737987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faff5534c95e49e18f14d69654fb4996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ba29c576d4a40a591668c4c304aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.745798 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d75c554e-0230-49d0-85a4-38a0a632eaad tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 200 len: 1305 microversion: 2.1 time: 0.127019 Aug 17 16:17:50.747100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 146/291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:50 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:50.832575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:50.833791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:50.842984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.843154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.843593 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.844367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:50.844822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:50.845244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:50.983354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:50.990664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2a1f001c-4596-432c-a54c-110413b034c1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.162569 Aug 17 16:17:50.991426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:50 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:51.322021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:51.323468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:51.331617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.332343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.333138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.334381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.335107 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.335679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.348773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:51.349875 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:51.360345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.369918 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.370602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.371916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.372550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.372976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.572989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:51.587459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5ff63e3f-e6a6-4eef-b354-31f58537ab2e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.268351 Aug 17 16:17:51.588304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 147/293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:51 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:51.593832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:51.594873 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:51.602878 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.603469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.604064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.604853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.605712 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.606986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.703981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:51.717298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:51.720264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:51.725417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a5fcfc3d-c228-4eeb-b5ff-47476d2f6cbf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.380406 Aug 17 16:17:51.725996 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 147/294] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:51 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:51.770479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:51.771158 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] [instance: a256d7e0-505d-4b06-8672-c5075f5d182a] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:51.785743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.786932 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.788705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.791761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:51.793001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:51.794402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:51.796126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:51.806541 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b9fbdbc0-b264-4058-90c4-4efee800aecf tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.216606 Aug 17 16:17:51.812632 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 148/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:51 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:51.845971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] HTTP exception thrown: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Request method failure captured: Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a HTTP/1.1 Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RSJu2_0tWreNIPkHS2PqdKUe87NL1X0mFAFWgsZz6NMKtSvq7vfY6nbw_iJs2fT62sXxiOI1MNx0pHKNSJrATXdgHpmsfFJgvdAq_yJNDuPaE-YBa0pEKKkTpDM1T2-8aIbcYcEP6EO090jbD503HcxAvPKAKpX1XPxqpagQYkooLw Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: e49ba29c576d4a40a591668c4c304aab Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesNegativeTest-495501641 Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:17:51.847895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e49ba29c576d4a40a591668c4c304aab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e49ba29c576d4a40a591668c4c304aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e49ba29c576d4a40a591668c4c304aab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e49ba29c576d4a40a591668c4c304aab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesNegativeTest-495501641 Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: e49ba29c576d4a40a591668c4c304aab Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesNegativeTest-495501641 Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesNegativeTest-495501641-project Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: faff5534c95e49e18f14d69654fb4996 Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesNegativeTest-495501641-project Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. Aug 17 16:17:51.849728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'a256d7e0-505d-4b06-8672-c5075f5d182a'} Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:17:51.850561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. Aug 17 16:17:51.853036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:17:51.854923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] Returning 404 to user: Instance a256d7e0-505d-4b06-8672-c5075f5d182a could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:17:51.854923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d8a65d0d-b700-4ab5-9bf3-80ee208bd775 tempest-VolumesNegativeTest-495501641 tempest-VolumesNegativeTest-495501641-project] 10.222.0.60 "GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a" status: 404 len: 111 microversion: 2.1 time: 0.085223 Aug 17 16:17:51.854923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 148/296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:51 2022] GET /compute/v2.1/servers/a256d7e0-505d-4b06-8672-c5075f5d182a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:17:52.012724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:52.013598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:52.020383 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.021094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.022031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.022965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.023783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.024325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.138530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bebdd9f1-7322-4837-b2df-80c188f96552", "tag": "5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:52.167843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.169043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.169907 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.197933 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] Creating event network-changed:5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd for instance bebdd9f1-7322-4837-b2df-80c188f96552 on hv-cinder-85220 Aug 17 16:17:52.218977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-b84dcf94-eec7-4838-8ed6-d7f6c7c97de6 req-2a387431-b940-4a31-903e-53d25325962a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085207 Aug 17 16:17:52.220220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 149/297] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:17:52.252997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.265539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-749e5c65-e68a-4c69-8a04-1cff5c53df39 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.256532 Aug 17 16:17:52.276793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:52 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:52.610339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:52.610964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:52.616980 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.617452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.617878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.618553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.619000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.619411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.634904 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:52.760369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:52.761133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:52.766136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.770600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.771162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.772119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.772960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.774045 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.774565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.775650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d3e44f93-5e85-422c-82e1-2e8f4f4c70cb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.170464 Aug 17 16:17:52.776648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 150/299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:52 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:52.838020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:52.838020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:52.845723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.846406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.846959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.847752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:52.848325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:52.848878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:52.931957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.941447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.943302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.944494 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-45fc948c-d07e-47c0-8e9b-10442643734a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.195672 Aug 17 16:17:52.945338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 150/300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:52 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:52.985881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:52.993887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-48ee303d-4805-4463-955a-56cd1a9308d0 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.167004 Aug 17 16:17:52.994435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 151/301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:52 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:53.289136 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:53.289771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:53.296711 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.297168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.297605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:53.298293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.298744 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.299164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:53.314703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:53.442244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:53.450833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-849faf26-5800-4ed8-aea6-4fcebd5d204a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.165424 Aug 17 16:17:53.451395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 151/302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:53 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:53.798308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:53.798978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:53.800977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:53.806106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.806590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.807023 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:53.807712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.808191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.808616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:53.967980 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:53.968563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:53.969200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:53.976630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.977115 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.977316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-22239815-5b99-4992-b79c-dabd2ad9b4a2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.183430 Aug 17 16:17:53.977547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:53.978402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 152/303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:53 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:53.978503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:53.978673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:53.979090 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:54.015702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:54.016344 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:54.023353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:54.025086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:54.025612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:54.026330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:54.026819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:54.027243 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:54.131861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:54.140663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:54.142735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:54.144167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-05fe79c2-ad7e-47e9-97b1-05a211f24344 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.180581 Aug 17 16:17:54.144981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 152/304] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:53 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:54.237030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:54.244499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b98563fe-0bc2-47ba-9f79-9e998160ff88 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.234150 Aug 17 16:17:54.245067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 153/305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:54 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:54.471984 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:54.472593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:54.479175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:54.479604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:54.480486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:54.481788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:54.482358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:54.482778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:54.618952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:54.628792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fca900b1-42e4-4f71-9654-a7d59af32bf3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.160620 Aug 17 16:17:54.629367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 153/306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:54 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:55.000021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:55.000629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:55.006639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.007117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.007546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.008259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.008712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.009124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.167562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:55.168299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:55.175871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.176400 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.176835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.177535 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.177983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.178407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.186516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.194872 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-28006597-a484-4921-9c29-2b110e824b06 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.199470 Aug 17 16:17:55.195643 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 154/307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:54 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:55.266277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:55.266807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:55.272669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.273151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.273573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.274257 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.274701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.275115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.320721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.329397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.330984 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.332376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3deed2b4-ee49-4e7a-90e7-5f0997c26a1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.168759 Aug 17 16:17:55.332935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 154/308] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:55 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:55.410175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.417814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-adf39856-06de-4f57-9bcb-0e6c5ec08cc1 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.156223 Aug 17 16:17:55.418447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 155/309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:55 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:55.650200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:55.650809 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:55.656907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.657381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.657809 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.658489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:55.658928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:55.659352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:55.788844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:55.796392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e917d28e-0641-430f-865b-c783ceec3401 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.150057 Aug 17 16:17:55.796952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 155/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:55 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:56.217590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:56.218191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:56.224368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.224852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.225281 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.225960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.226411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.226825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.357660 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:56.358335 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:56.366017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.366292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:56.366565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.367118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.367850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.368308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.368733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.374914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-101bd530-edea-4229-b49e-2fb4cfed5ddf tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.161059 Aug 17 16:17:56.376133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 156/311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:56 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:56.442133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:56.442739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:56.451193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.451679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.452142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.452844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.453297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.453718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.553420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:56.561725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:56.563225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:56.564402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e258ed74-a715-4d20-a34e-b08b62df54e2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.211599 Aug 17 16:17:56.565607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 156/312] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:56 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:17:56.666752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:56.673616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:56.676489 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0b9ac841-7051-4492-a385-4cf20e167db2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.238420 Aug 17 16:17:56.677460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 157/313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:56 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:56.818874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:56.819544 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:56.828091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.828885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.829936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.831296 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:56.831893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:56.832543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:56.881537 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:57.009469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.016335 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f569d9f3-2d22-4570-aa90-bce9b6a0d711 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.202640 Aug 17 16:17:57.016946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 157/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:56 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:57.350997 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "name": "network-vif-plugged", "status": "completed", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:57.356960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:57.363246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.363870 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.364481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.376886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] Creating event network-vif-plugged:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:17:57.382696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-4ccc8751-bc7a-4a19-9b35-762c4e4f3cd9 req-e6b86dc3-b354-4f17-82dc-8b41ffd9121c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037615 Aug 17 16:17:57.383289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 158/315] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:57.395500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:57.396135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:57.402411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.403219 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.403657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.404388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.404838 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.405437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.574334 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.583010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-88bb81e7-dfcd-48a4-a60c-37737f68a85a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.191139 Aug 17 16:17:57.589370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:57.590114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:57.592371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 158/316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:57 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:57.596756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.597465 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.597899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.599530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.600100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.600624 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.698147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:57.698760 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:57.705105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.705588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.706019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.706714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:57.707750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:57.707750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:57.860280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.872776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.874555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.875939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-46a0e4e3-becd-4afd-93f5-bcfe73d14920 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.291410 Aug 17 16:17:57.876963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 159/317] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:57 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:57.913663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:57.923888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bad0943d-28ee-40cb-98de-01a78d826ec2 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.229283 Aug 17 16:17:57.924682 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 159/318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:57 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:58.038391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:58.039004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:58.045768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.046264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.046723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.047410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.048003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.048354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.215420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:58.222900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a18b7f74-c58b-4a28-8aa1-130f7c494ed5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1358 microversion: 2.1 time: 0.188272 Aug 17 16:17:58.223796 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 160/319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:58 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:58.604883 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:58.606137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:58.612765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.613240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.613669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.614355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.614805 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.615222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.752026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:58.760104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-15461b82-235f-4053-a7f2-11f8be455c92 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.158969 Aug 17 16:17:58.760676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 160/320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:58 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:58.907351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:58.908101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:58.915460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.928647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.929334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.931297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.931297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.931297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.945436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:58.946038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:58.957131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.957621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.958052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:58.958757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:58.959206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:58.959622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.160567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.170477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.174032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.176411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-051744b9-9174-4494-a27e-d23f8667b450 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.274002 Aug 17 16:17:59.177535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 161/321] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:17:58 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:17:59.195155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.203843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ca93f47b-30b8-4277-95e8-c6ae74f09bd4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.262107 Aug 17 16:17:59.204459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 161/322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:58 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:59.244419 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:59.245202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:59.251278 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.251829 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.252451 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.253137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.253586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.254077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.394355 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.399416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebdd9f1-7322-4837-b2df-80c188f96552", "name": "network-vif-plugged", "status": "completed", "tag": "5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:17:59.401988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6c20a176-aa9c-4404-976f-7d56abdf5108 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1548 microversion: 2.1 time: 0.161441 Aug 17 16:17:59.402596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 162/323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:59 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:17:59.408735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.409198 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.409618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.420709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] Creating event network-vif-plugged:5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd for instance bebdd9f1-7322-4837-b2df-80c188f96552 on hv-cinder-85220 Aug 17 16:17:59.422848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:59.423455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:59.425771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-3c006c96-615e-4597-96b8-5be3d4f695a5 req-1bda970f-109a-4307-a61d-b0bbd04aa006 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029891 Aug 17 16:17:59.426350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 162/324] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:17:59.430656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.431137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.432090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.432796 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.433254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.434196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.587305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.597324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0c69d973-b91e-4c66-a1c1-2d4903935c16 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1548 microversion: 2.1 time: 0.178281 Aug 17 16:17:59.598577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 163/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:59 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:17:59.623659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:59.628440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.629220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Searching by: {'deleted': False, 'project_id': 'c73a224fc7784fd6876e81a0e7097127'} {{(pid=120794) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 16:17:59.631158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:59.637705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.638491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.638921 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.639641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.640201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.640563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.730314 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.multi_cell_list [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 16:17:59.782058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:59.782577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:59.790352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.790931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.791540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.792361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.793503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.794040 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.840895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7a19cefb-2aad-4afd-b0b0-3430a1a65caf tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225838 Aug 17 16:17:59.842372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 163/326] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Aug 17 16:17:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:17:59.854958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:17:59.856272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:17:59.862803 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.863293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.863727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.864473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:17:59.864925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:17:59.865538 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:17:59.943625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:17:59.952143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cc9b7e44-cb5d-46c5-a316-eaa6f421a98a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.174354 Aug 17 16:17:59.953002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 164/327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:59 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:00.022385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:00.030478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f8ee29e1-3d65-468e-a7b8-9d0bd5cd312b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1548 microversion: 2.1 time: 0.179500 Aug 17 16:18:00.031037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 164/328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:17:59 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:00.203263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:00.203896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:00.209969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.210450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.210882 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:00.211698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.212184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.212605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:00.226431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:00.227409 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:00.233834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.234631 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.235608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:00.236543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.237201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.237853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:00.366940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:00.377391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:00.380096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:00.381458 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0e38e22a-0fe5-4f8c-86f1-273d1efa508c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.182920 Aug 17 16:18:00.382530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 165/329] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:00 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:00.412959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:00.439026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d409cf34-5938-41ef-8698-3000523ac494 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1313 microversion: 2.1 time: 0.216600 Aug 17 16:18:00.453368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:00 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:00.978850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:00.979448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:00.986676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.987309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.987560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:00.988338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:00.988887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:00.989367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:01.196038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:01.209651 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1d2d168d-c40b-4cfd-ac72-3731c917b976 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.234630 Aug 17 16:18:01.210166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:00 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:01.406573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:01.407213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:01.413724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:01.414209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:01.414645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:01.415375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:01.415847 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:01.416273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:01.460075 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:01.460605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:01.467333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:01.468163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:01.468602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:01.469303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:01.469761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:01.470186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:01.556397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:01.569287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:01.572687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:01.572687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ca0b758f-7e13-4839-9ac7-98429b16c8bf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.170003 Aug 17 16:18:01.584251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 166/332] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:01 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:01.634609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:01.642189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:01.644609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-da3832e6-24c4-46d3-9c1c-86f024a37e3b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1496 microversion: 2.1 time: 0.188387 Aug 17 16:18:01.645183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 167/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:01 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1496 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:02.065902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfa12b9a-53dd-46fb-a336-762de029cf37"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:02.068351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:02.074498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.074975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.075409 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.076118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.076571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.076992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.233490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:02.234098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:02.240240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.240719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.241148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.241830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.242279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.242694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.377566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:02.385369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ba7614df-498a-44b0-90fd-fa5eaf48cf56 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.156438 Aug 17 16:18:02.385932 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 168/334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:02 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:02.596304 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:02.596914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:02.603099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.603581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.604047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.604734 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:02.605183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:02.605671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:02.741379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:02.749640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:02.751162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:02.752316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-69af3c08-2ec2-4221-a588-0dc5bcd5db4c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.159904 Aug 17 16:18:02.752876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 169/335] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:02 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:03.405446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:03.406121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:03.412072 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:03.412550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:03.412979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:03.413660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:03.414110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:03.414529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:03.541666 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:03.549671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-69053f17-d9f5-4167-bf66-cc7a2ed09130 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.148089 Aug 17 16:18:03.550238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 170/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:03 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:03.775387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:03.776003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:03.782685 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:03.783195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:03.783618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:03.784334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:03.784782 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:03.785199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:03.919247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:03.927428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:03.928914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:03.930204 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-79f0f885-ef4b-4d30-935a-b5bf004a9dd2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.158641 Aug 17 16:18:03.930772 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 171/337] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:03 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:04.547874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:04.570731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:04.571399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:04.578663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.579153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.579684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.580417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.580929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.581316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.693992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-543818ae-6ee2-40da-82a1-4d27d7fd9f96 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.631858 Aug 17 16:18:04.694589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 167/338] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:18:02 2022] POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 194 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:04.700141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:04.701206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:04.716643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.717467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.718649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.719790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.720478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.721065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.743611 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:04.756716 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:18:04.771557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-727ec15d-add8-4157-94d0-59601afd8a78 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.204818 Aug 17 16:18:04.772743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 172/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:04 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:04.871608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-68688185-224b-47ee-8340-7b71bba86277 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 204 len: 0 microversion: 2.1 time: 0.175014 Aug 17 16:18:04.872228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 168/340] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:18:04 2022] DELETE /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:18:04.880437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:04.881046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:04.887566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.888237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.888669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.889352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.889801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.890222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.955586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:04.956548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:04.962520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.962968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.963407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:04.964160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:04.965199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:04.965677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:05.044423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:05.063239 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-70b40ad0-746a-4578-bc85-adbb44fee8e4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1502 microversion: 2.1 time: 0.180549 Aug 17 16:18:05.075423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 173/341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:04 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:05.138383 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:05.146491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:05.148062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:05.149222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-815be0c2-d72f-4681-ba20-fc80e60d6f3c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.198214 Aug 17 16:18:05.149778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 169/342] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:04 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:05.794521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:05.795551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:05.801860 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:05.802477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:05.803073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:05.804149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:05.804714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:05.805140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:05.948499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:05.958037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8787ff5b-7b52-4a1d-a205-a7ca95a9c833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.168000 Aug 17 16:18:05.958687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 174/343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:05 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:06.081514 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:06.082236 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:06.091636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.092395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.093152 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.093807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.094320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.094797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.172449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:06.173059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:06.182767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.184798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.191238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.192735 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.194375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.195693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.346354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:06.360158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1fa0c49f-0e30-44d8-b509-a3f59afe693f tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1502 microversion: 2.1 time: 0.282572 Aug 17 16:18:06.360771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 170/344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:06 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1502 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:06.372132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "name": "network-vif-plugged", "status": "completed", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:06.388472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.389163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.389592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.401292 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] Creating event network-vif-plugged:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:18:06.407619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-92d6bf97-816f-423c-9fbc-fbbe5a5bf2fe req-d38ce212-b9f8-44b4-8b86-5eac0ddb7d95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045258 Aug 17 16:18:06.408498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 171/345] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:06.416391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:06.426913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:06.428840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:06.430074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0079892b-251c-4525-8b93-354767e4e365 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.262289 Aug 17 16:18:06.431218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 175/346] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:06 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:06.979758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:06.980539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:06.987860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.988393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.988909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:06.989650 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:06.990127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:06.990555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:07.127750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:07.135367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-534ccd83-ab1a-477f-b1a2-76f410643ee2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.159891 Aug 17 16:18:07.135949 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 172/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:06 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:07.381994 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:07.383279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:07.389653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:07.390139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:07.390571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:07.391265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:07.391721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:07.392164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:07.455975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:07.456663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:07.475109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:07.475606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:07.476071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:07.476941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:07.478402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:07.479272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:07.571994 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:07.581998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1b757dd7-a53d-42d5-98b7-0d1825e9518d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1502 microversion: 2.1 time: 0.203698 Aug 17 16:18:07.582818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 176/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:07 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:07.648469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:07.660304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:07.662416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:07.666005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bcacb441-8320-4ed0-ae43-d7690fbb7969 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1743 microversion: 2.20 time: 0.214608 Aug 17 16:18:07.667746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 173/349] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:07 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:08.159768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:08.160544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:08.173062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.174013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.174729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:08.175681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.176522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.177318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:08.453042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:08.467040 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a93390d0-7e1f-420b-82dc-4e69e6e7cff3 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.313511 Aug 17 16:18:08.468081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 177/350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:08 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:08.609927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:08.611210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:08.632929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.634002 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.634831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:08.636067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.638151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.643525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:08.697024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:08.698285 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:08.708806 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.709604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.710288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:08.711244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:08.712276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:08.713224 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:09.007422 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:09.018100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fc36425f-14c1-429e-9e25-e73ec98eac4b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1502 microversion: 2.1 time: 0.413446 Aug 17 16:18:09.021293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 174/351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:08 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:09.202190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:09.217170 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:09.219126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:09.220574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-182bf0d1-47e5-48c6-9710-3c8d460042c9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.527588 Aug 17 16:18:09.222422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 178/352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:08 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:09.385299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebdd9f1-7322-4837-b2df-80c188f96552", "name": "network-vif-deleted", "tag": "5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:09.396815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:09.397292 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:09.397724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:09.411424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] Creating event network-vif-deleted:5b1a1d26-4cf7-44bf-a585-ea4c8d9076dd for instance bebdd9f1-7322-4837-b2df-80c188f96552 on hv-cinder-85220 Aug 17 16:18:09.417705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-26898c67-ec03-4764-b78d-7f74aef8294b req-afd9cb73-f6f8-48e4-80a5-5c04448c57b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Aug 17 16:18:09.419029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 175/353] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:09.499367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:09.500809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:09.508819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:09.509803 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:09.510462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:09.512362 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:09.513378 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:09.514252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:09.720580 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:09.729133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ea0c81ca-9847-44d7-a57d-b1fbced29da8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.243821 Aug 17 16:18:09.733171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 179/354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:09 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:10.040837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:10.046648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:10.047583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:10.055329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.056230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.056880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:10.058233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.059555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.064013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:10.177688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:10.188681 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0bca1fc9-0aff-4dab-9f31-cf659142602e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 200 len: 1298 microversion: 2.1 time: 0.149180 Aug 17 16:18:10.191117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 176/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:10 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:10.249813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:10.250447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:10.260803 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.261292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.261756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:10.262471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.265622 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.266064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:10.535085 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:10.553073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:10.555337 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:10.556583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-08b93aa8-fb6b-41b6-aab6-cf828cbc9154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.315979 Aug 17 16:18:10.557146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 180/356] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:10 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:10.752953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:10.753970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:10.760570 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.761366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.763523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:10.764612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:10.765287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:10.766002 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.073991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:11.084907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8e8e3fdb-abbd-43af-b511-4fdb21c72ea2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1502 microversion: 2.1 time: 0.335734 Aug 17 16:18:11.086438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 177/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:10 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:11.110519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3048aaf-3b93-4e0c-a217-4937f0e4ea45"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:11.113724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:11.132990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.137254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.137747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.139004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.139722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.140595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.179309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] HTTP exception thrown: Cannot 'attach_volume' instance 153d19a6-a000-4320-8e36-d1528026298f while it is in vm_state rescued Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Request method failure captured: Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/os-volume_attachments HTTP/1.1 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 74 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQqHZKuaAiyqFjaNcW4VDU4SIhJamf9MhR-Y4YYnOc5FSet_KVS4jphoPy2GrHow9_JyfSVl9dw1VFA_2ge4UFA5oLrcBO5Ah_BJnSXxd8mm0Uuf_WZ4HHrc3ci8EEEPHKEqy-gVhGXDuwi8b4yKMPmqPKkHEXc4v759UwKAgWVFIk Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:18:11.182547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34b7fa307d994f2792503e6761f3c079", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 9fe81a429dee4fba8708445dcefa293e Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {"volumeAttachment": {"volumeId": "a3048aaf-3b93-4e0c-a217-4937f0e4ea45"}} Aug 17 16:18:11.184480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Cannot 'attach_volume' instance 153d19a6-a000-4320-8e36-d1528026298f while it is in vm_state rescued Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'server_id': '153d19a6-a000-4320-8e36-d1528026298f', 'body': {'volumeAttachment': {'volumeId': 'a3048aaf-3b93-4e0c-a217-4937f0e4ea45'}}} Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 153d19a6-a000-4320-8e36-d1528026298f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:18:11.185390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 153d19a6-a000-4320-8e36-d1528026298f while it is in vm_state rescued Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:11.193001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:11.194591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:18:11.194591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:18:11.194591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 153d19a6-a000-4320-8e36-d1528026298f while it is in vm_state rescued Aug 17 16:18:11.194591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.197123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Returning 409 to user: Cannot 'attach_volume' instance 153d19a6-a000-4320-8e36-d1528026298f while it is in vm_state rescued {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:18:11.198234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7a587b4d-297f-4029-8630-c92a33973ffe tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.095216 Aug 17 16:18:11.199929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 181/358] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:18:11 2022] POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/os-volume_attachments => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 16:18:11.208259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:11.208798 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:11.232621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.233675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.236402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.238840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:11.239464 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: bebdd9f1-7322-4837-b2df-80c188f96552] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:11.240401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.240829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.241862 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.268672 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.269175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.269605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.271545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.280476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.281274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.333889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] HTTP exception thrown: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Request method failure captured: Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 HTTP/1.1 Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RSotTg9EhLK0Fp0GO4NLHQZaJX6qjY-73_bS6fZMpMi2-ENYApDcJdjlO5DcNJpINhde8oGKR-Mt3RZ3Mq7wirSlcz6i3BhEi3RUkFVrMQ4DIj-VRnwtVmHrGHy5cXXoQu68cpDMvj4FLMCYGf5kzWsBkiIRo0CXPARptKSdEvUn7o Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 07cd27d906cc4496bdeaf929ff4ec21e Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:18:11.336343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_07cd27d906cc4496bdeaf929ff4ec21e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 07cd27d906cc4496bdeaf929ff4ec21e Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesActionsTest-1388250773-project Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: f945c8c54cb14c0da00b647663278410 Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesActionsTest-1388250773-project Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. Aug 17 16:18:11.337646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'bebdd9f1-7322-4837-b2df-80c188f96552'} Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:18:11.338416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. Aug 17 16:18:11.339575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:18:11.346442 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Returning 404 to user: Instance bebdd9f1-7322-4837-b2df-80c188f96552 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:18:11.349302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b5f11cfb-e883-4023-b312-6a65c5c9948c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552" status: 404 len: 111 microversion: 2.1 time: 0.127348 Aug 17 16:18:11.350175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 182/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:11 2022] GET /compute/v2.1/servers/bebdd9f1-7322-4837-b2df-80c188f96552 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:18:11.444159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d7d5ab76-5c23-49da-ae91-eefea2d8a317 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/action" status: 202 len: 0 microversion: 2.1 time: 0.239425 Aug 17 16:18:11.448798 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 178/360] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:18:11 2022] POST /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:18:11.455934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:11.457070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:11.467532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.468486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.469172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.470121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.470812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.471492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.586563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:11.587946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:11.609658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.613021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.614047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.615033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:11.618156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:11.619193 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:11.872205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:11.884912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fba7d593-d7ed-4fdc-b310-831387b47653 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1510 microversion: 2.1 time: 0.432444 Aug 17 16:18:11.900888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 183/361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:11 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1510 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:11.907046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1423703431", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "networks": [{"uuid": "475d4777-9f80-4e6c-bdd3-d3040fe7dc81"}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:12.068820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:12.078498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:12.081133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:12.082635 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e067828a-9097-4a7b-9215-237a547eccbc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.501588 Aug 17 16:18:12.084347 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 179/362] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:11 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:12.910934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:12.911450 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:12.919202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:12.919791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:12.920263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:12.920958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:12.921411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:12.922191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:13.335709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:13.349441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d2070030-888d-4343-8c4c-8b136a14ac27 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1510 microversion: 2.1 time: 0.441897 Aug 17 16:18:13.352903 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 180/363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:12 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:13.360169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:13.361090 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:13.368420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:13.369362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:13.370052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:13.381011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:13.381968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:13.382672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:13.747009 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:13.780122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:13.782427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:13.784140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-eb601723-6bc9-4540-a22f-482c7adb177c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.429567 Aug 17 16:18:13.785059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 181/364] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:13 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:14.374322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:14.375046 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:14.401382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:14.401803 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:14.402803 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:14.411358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:14.411882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:14.412329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:14.470796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:14.711571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:14.725527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-03fa1477-7f86-4e03-b305-612cce459055 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1510 microversion: 2.1 time: 0.355634 Aug 17 16:18:14.741244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 182/365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:14 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:14.809064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:14.810073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:14.816400 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:14.817235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:14.817951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:14.818877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:14.819542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:14.820218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:15.059964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:15.072291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:15.073805 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:15.076099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ec94e28d-a3af-48bb-b3ca-a656423ff154 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.270954 Aug 17 16:18:15.077169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 183/366] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:14 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:15.753082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:15.758841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:15.773357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:15.774213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:15.775913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:15.778142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:15.778952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:15.780362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:16.016346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:16.025221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2c633122-8cd3-4979-bc97-94ea0334f3da tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1516 microversion: 2.1 time: 0.278780 Aug 17 16:18:16.027970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 184/367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:15 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:16.103775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:16.104336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:16.116730 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:16.117224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:16.118299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:16.119976 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:16.122145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:16.122975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:16.251056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] validate_networks() for [('475d4777-9f80-4e6c-bdd3-d3040fe7dc81', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:18:16.548491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:16.564068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:16.574031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:16.580083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-557dc76d-9911-40ca-bbe9-80348dd46ccd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.480708 Aug 17 16:18:16.581175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 185/368] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:16 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:17.181201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:17.181920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:17.190128 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.190910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.191513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.192510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.193136 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.193715 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.410288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:17.424943 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5ae18025-ed7d-4ebd-b2f9-3a4ce7945106 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1594 microversion: 2.1 time: 0.258241 Aug 17 16:18:17.446357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 186/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:17 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1594 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:17.568534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:18:17.569799 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:18:17.570440 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:18:17.572935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:18:17.574812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:18:17.586748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.587518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.588225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.589111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.590055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.591112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.625481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:17.628968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:17.658558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.659048 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.659479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.660213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:17.660663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:17.661082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:17.692676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Getting quotas for project 07cd27d906cc4496bdeaf929ff4ec21e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:17.706218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Getting quotas for user f945c8c54cb14c0da00b647663278410 and project 07cd27d906cc4496bdeaf929ff4ec21e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:17.752106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:18:17.755967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:18:17.881862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b0d4bbb8-423e-4fcb-b049-66f8ee3b70f4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.975939 Aug 17 16:18:17.883045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 184/370] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:18:17.902291 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ca508912-cb33-462f-a828-6a1dc8394966 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:17.903524 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ca508912-cb33-462f-a828-6a1dc8394966 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:18.039200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ca508912-cb33-462f-a828-6a1dc8394966 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:18.049724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:18.049876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ca508912-cb33-462f-a828-6a1dc8394966 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1214 microversion: 2.1 time: 0.150120 Aug 17 16:18:18.052567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 185/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:17 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:18.067667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e351c61-c98a-49ba-b607-c4e56a8b4d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: .version_select at 0x7f9eea73cdc0>, body: {"keypair": {"name": "tempest-keypair-1638558449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVIHNCByli2eSFIaoSMCpufb4C0ALARDpEX5ICnwdi46euAJv0sHVBVlSGvZrzAHAFfPBKAXfzTIsjSGv0ZONv+6itK+yJAdnaEA/DhJncDTzDOPJ+ybmoYe8R7E9utSQ=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:18.075662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:18.079993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:18.089953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a89ee9a6-8156-4417-904b-b409815f33b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.485499 Aug 17 16:18:18.091054 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 187/372] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:17 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:18.107309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0e351c61-c98a-49ba-b607-c4e56a8b4d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for project 34b7fa307d994f2792503e6761f3c079. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:18.116086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0e351c61-c98a-49ba-b607-c4e56a8b4d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for user 9fe81a429dee4fba8708445dcefa293e and project 34b7fa307d994f2792503e6761f3c079. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:18.174279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0e351c61-c98a-49ba-b607-c4e56a8b4d19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120332 Aug 17 16:18:18.199145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 186/373] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:18:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:19.104202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:19.106113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:19.117590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:19.118896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:19.133924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:19.142986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:19.151797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:19.152792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:19.153913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:19.154308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:19.154794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:19.155345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:19.157294 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:19.158134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:19.159718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:19.165279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:19.425596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:19.435196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-af8cb0ae-5acf-4b73-8eed-671f9da8b75d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1218 microversion: 2.1 time: 0.365743 Aug 17 16:18:19.435786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 188/374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:19 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1218 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:20.074532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:20.093252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:20.095075 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:20.096541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-75a4d870-b91b-4bfe-a251-79de31b02737 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.983714 Aug 17 16:18:20.097032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 187/375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:19 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:20.463105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:20.463820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:20.484458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:20.485930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:20.489265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:20.490504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:20.492559 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:20.494082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:20.757947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:20.772456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f0b9b53f-12a7-46ab-804b-68f126eacffb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1272 microversion: 2.1 time: 0.312953 Aug 17 16:18:20.775397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 189/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:20 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:21.123365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:21.124392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:21.146720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:21.147213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:21.168976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:21.170813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:21.181769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:21.184964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:21.282378 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:21.807365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:21.808027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:21.821270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:21.823916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:21.826631 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:21.827555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:21.828195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:21.828790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:22.215833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:22.224645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-45f45c14-761b-4f06-b79f-81ad0fbab7ea tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1272 microversion: 2.1 time: 0.422632 Aug 17 16:18:22.236013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 190/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:21 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1272 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:22.576034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:22.607292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:22.610107 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:22.619023 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d0a82d5a-7bac-4dc9-b1fb-c45add2d59d7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 1.501175 Aug 17 16:18:22.620216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 188/378] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:21 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:22.892808 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1408172598", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e3a2be7-1776-4ee7-a497-68ec01d73e19"}], "security_groups": [{"name": "tempest-securitygroup--17259098"}], "key_name": "tempest-keypair-1638558449", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:23.086802 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] validate_networks() for [('2e3a2be7-1776-4ee7-a497-68ec01d73e19', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:18:23.254422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:23.255469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:23.257660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:23.272715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:23.273506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:23.280229 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:23.281231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:23.281926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:23.284957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:23.753730 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:23.770655 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3b7a7a9c-0679-4509-abf2-a4c3c6b8b929 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1272 microversion: 2.1 time: 0.518974 Aug 17 16:18:23.775325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 189/379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:23 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:23.782354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:23.793676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:23.827483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:23.830216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:23.835375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:23.842818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:23.848102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:23.850674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:24.413861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:18:24.414408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:18:24.414759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:18:24.415167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:18:24.416518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:18:24.439282 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:24.447486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:24.448011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:24.449453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:24.458918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:24.459509 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:24.514627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:24.526432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Getting quotas for user 9fe81a429dee4fba8708445dcefa293e and project 34b7fa307d994f2792503e6761f3c079. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:24.562154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:18:24.567452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:18:24.714338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:24.726390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:24.728766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2c0ea799-fd04-4f73-a63c-d805ff23017e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.840064 Aug 17 16:18:24.733134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 191/380] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:18:22 2022] POST /compute/v2.1/servers => generated 407 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 16:18:24.736238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:24.749044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1223f7cc-1d3c-47fa-848c-78dc49211881 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.972450 Aug 17 16:18:24.750837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 190/381] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:23 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:24.752622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:24.764274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f9f05238-25ce-4b37-be07-81ec6c4d1084 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:24.776454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f9f05238-25ce-4b37-be07-81ec6c4d1084 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:24.805519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:24.807054 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:24.807352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:24.849064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] Creating event network-changed:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:18:24.868859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-e5289c3f-ce3c-4a1e-8ef8-1c61c1e38013 req-0126b794-d479-4471-8e54-7132e4f84337 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132017 Aug 17 16:18:24.869518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 192/382] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:24.884605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:24.888116 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:24.896021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f9f05238-25ce-4b37-be07-81ec6c4d1084 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:24.904130 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f9f05238-25ce-4b37-be07-81ec6c4d1084 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1246 microversion: 2.1 time: 0.150116 Aug 17 16:18:24.908564 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 191/383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:24 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1246 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:24.932753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:24.935499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:24.937056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:24.940107 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:24.941224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:24.941674 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:25.350629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:25.365385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3a78aba3-4022-4813-afd1-86ab5bf4458b tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.492531 Aug 17 16:18:25.378300 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 193/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:24 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:25.776525 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:25.777289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:25.788329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:25.789041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:25.792100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:25.793165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:25.793856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:25.794501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:25.933935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:25.935314 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:25.945764 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:25.950350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:25.951155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:25.952548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:25.957578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:25.958248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:26.157447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:26.169383 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e131bba3-5d35-43aa-81c0-fc2ad3d9d07e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1242 microversion: 2.1 time: 0.240255 Aug 17 16:18:26.170237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 194/385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:25 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:26.392982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:26.393700 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:26.404982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:26.405548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:26.406053 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:26.406823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:26.407344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:26.407999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:26.568893 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:26.578729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:26.588011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:26.594700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e005fcdb-240e-4e04-92d1-39140ef2dc0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.822665 Aug 17 16:18:26.609824 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 192/386] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:25 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:27.192209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:27.193545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:27.211833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:27.213862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:27.217408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:27.218549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:27.219260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:27.224691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:27.389755 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:27.404213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-35e6b8ab-49a6-4789-8947-ea495c9f457a tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 1.014938 Aug 17 16:18:27.405878 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 195/387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:26 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:27.462940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92340ec7-7065-4256-a989-a013b7a7dd57", "tag": "aa3dad7a-f5b4-464f-838c-cb99dd6fc98a"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:27.482422 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:27.484889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:27.488340 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:27.496388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:27.508629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-73c23415-104e-4c37-9160-b2364cfd378b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1304 microversion: 2.1 time: 0.321174 Aug 17 16:18:27.509211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 193/388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:27 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:27.543697 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] Creating event network-changed:aa3dad7a-f5b4-464f-838c-cb99dd6fc98a for instance 92340ec7-7065-4256-a989-a013b7a7dd57 on hv-cinder-85220 Aug 17 16:18:27.550044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-27780bf2-0b19-4c88-b074-3e53caa86c5b req-994ce6e2-cc71-4ee0-8fec-6fa19940881d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093920 Aug 17 16:18:27.551398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 196/389] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:27.638268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:27.639195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:27.652708 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:27.654961 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:27.655761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:27.656476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:27.658062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:27.659866 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:27.660538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.179983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:28.210173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:28.222867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:28.228822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2848cade-f401-426e-8547-d00d94887a22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.593406 Aug 17 16:18:28.231187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 194/390] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:27 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:28.288119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-494233265"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:28.289006 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:28.298281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.299047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.299638 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.300530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.301354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.301953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.426780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:28.427757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:28.435529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.436806 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.438737 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.440305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.441377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.442375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.622430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.network.security_group_api [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Adding security group de3de8df-80e0-420d-b00c-4150ec15d32f to port bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 Aug 17 16:18:28.748370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:28.761484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f9c7d7af-1b0e-49dd-921e-770474945dfb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.338553 Aug 17 16:18:28.768592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 195/391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:28 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:28.793595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:28.794792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:28.820828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.821467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.824794 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:28.826917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:28.830905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:28.831574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.001035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:29.011572 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c0628086-5a8a-4913-b590-96ac09438930 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1304 microversion: 2.1 time: 0.240436 Aug 17 16:18:29.012200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:28 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:29.253526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:29.254623 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:29.267200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.267979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.270584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.275636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.289432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.291900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.783455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:29.795368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:29.797754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:29.799261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-feb26714-0ddb-4ee1-837e-2b25911d4b72 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1738 microversion: 2.20 time: 0.549690 Aug 17 16:18:29.800431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 197/393] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:29 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1738 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:29.805200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:29.806394 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:29.814013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.814679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.815901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.817166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.817781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.818360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.909063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-56488a65-0248-4a22-b021-d5a7f9da8816 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action" status: 202 len: 0 microversion: 2.1 time: 1.625674 Aug 17 16:18:29.910733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 197/394] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:18:28 2022] POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action => generated 0 bytes in 1628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:18:29.922946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:29.924066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:29.930659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:29.932630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.933643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.934461 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:29.935505 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:29.936587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:29.937291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:30.280276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:30.301617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-434ebaf0-0f1c-47e3-b105-08d78f6ff48d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1759 microversion: 2.1 time: 0.386507 Aug 17 16:18:30.323360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:29 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1759 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:30.323360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:30.330311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:30.331283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:30.331726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:30.357959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] Creating event network-changed:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:18:30.367428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-416accf6-389c-4ffb-8b05-7a876fab9f7a req-db005f03-b8a7-4c01-aec9-e578616dd238 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053648 Aug 17 16:18:30.368890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 199/396] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:30.376242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:30.377703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:30.389713 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:30.390209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:30.390647 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:30.391354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:30.392020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:30.392446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:30.562743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:30.578784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c55d0131-b664-455a-a399-89b2414179fd tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.776359 Aug 17 16:18:30.591849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 198/397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:29 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:30.821849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:30.824766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:30.825679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:30.831457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-89126919-06da-4e11-abb5-7fa85feae918 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.461230 Aug 17 16:18:30.834764 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 200/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:30 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:30.840537 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:30.841333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:30.841831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:30.843278 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:30.844056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:30.844706 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:31.252398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:31.262052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:31.264002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:31.265481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2d8316f6-d601-4ebb-9816-ddba9321e3fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1720 microversion: 2.20 time: 0.446121 Aug 17 16:18:31.266887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 199/399] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:30 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1720 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:31.604673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:31.604673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:31.617560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:31.618539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:31.618656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:31.619284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:31.619744 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:31.622269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:31.859251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:31.860037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:31.882833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:31.883320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:31.883760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:31.884491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:31.884944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:31.889749 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:32.056815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:32.065728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f3624c1f-9a18-4b6f-afb1-303fc51aa3ff tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.466737 Aug 17 16:18:32.066366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 201/400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:31 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:32.280691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:32.290697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0d091028-eeb6-4760-8c55-33dd8765e859 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.434074 Aug 17 16:18:32.291289 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:32.292175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:32.305466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:32.306105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:32.306700 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:32.308293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:32.309254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:32.309670 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 200/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:31 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:32.312184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:32.316894 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:32.422056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:32.432911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:32.434219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:32.435530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:32.453277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] Creating event network-changed:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:18:32.472801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-4a89007f-5b9b-49bf-9ce7-fb05fa967a0a req-480db6a4-5cc6-4985-b521-6fe6bfbfb9c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054087 Aug 17 16:18:32.473236 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 201/402] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:32.804792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:32.829270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:32.831474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:32.832195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-24b032e0-5ccd-4ea6-9f1f-b02f517aa60f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1720 microversion: 2.20 time: 0.545723 Aug 17 16:18:32.838972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 202/403] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:32 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1720 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:33.090322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:33.090850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:33.098809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.099592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.100276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:33.101323 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.102006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.102644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:33.469641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-41232fc4-f241-4495-aa81-bc756f9e008a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Action: 'create', calling method: .version_select at 0x7f9eea391940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-965676027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoIxFn0jvt4uIDsCFmF1Vt3IycXp07pC9pOaqdxXgKTkcZyJbOT1WGNvz2gP20V/MMLsob0euSn1TSEpx9rZUF+ACOI/rKNiWuDqYiv0x1+05yN3X6TeJN1MaigsieUfA=="}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:33.486854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-41232fc4-f241-4495-aa81-bc756f9e008a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:33.488731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:33.491932 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-41232fc4-f241-4495-aa81-bc756f9e008a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for user 2f7f4cf57e814aebab32a56b19aa067f and project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:33.500090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c152d4a2-b43f-4834-bc3a-b521b13beddb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.415234 Aug 17 16:18:33.500997 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:33 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:33.506992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:33.508047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:33.519241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.520562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.521602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:33.523009 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.523625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.524852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:33.541080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-41232fc4-f241-4495-aa81-bc756f9e008a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.291797 Aug 17 16:18:33.542937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 203/405] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:18:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:33.753435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:33.762901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-83f6a80f-6d40-4b5c-a316-04e0d2a40ae2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.260477 Aug 17 16:18:33.763960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:33 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:33.863163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:33.864420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:33.879428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.885308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.887797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:33.889375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:33.892071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:33.903351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.128837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:34.155514 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:34.158629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:34.161486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-664da7f7-fa83-48f2-a1ee-5d547676f7a4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1720 microversion: 2.20 time: 0.302324 Aug 17 16:18:34.171837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 204/407] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:33 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1720 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:34.532074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:34.532607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:34.543910 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:34.545175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:34.546916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.549345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:34.549992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:34.551878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.566417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92340ec7-7065-4256-a989-a013b7a7dd57", "name": "network-vif-plugged", "status": "completed", "tag": "aa3dad7a-f5b4-464f-838c-cb99dd6fc98a"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:34.584594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:34.606237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:34.607112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:34.608204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.636829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] Creating event network-vif-plugged:aa3dad7a-f5b4-464f-838c-cb99dd6fc98a for instance 92340ec7-7065-4256-a989-a013b7a7dd57 on hv-cinder-85220 Aug 17 16:18:34.655903 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-5dbad321-7512-4c1f-810d-cfba34e8fd76 req-184dd926-2eba-4eb1-ba28-246deb896302 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093575 Aug 17 16:18:34.657074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 205/408] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:34.787022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:34.787649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:34.796368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:34.797078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:34.797671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.798528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:34.799156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:34.799728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:34.800208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:34.813302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-dbb4c0ea-0a72-4951-ae98-296ac752c3a3 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.285287 Aug 17 16:18:34.814107 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 204/409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:34 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:35.009056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:35.018588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-62d9c064-12d9-49a6-80a6-b9e5af20254f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.236551 Aug 17 16:18:35.019515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 206/410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:34 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:35.189936 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:35.190430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:35.194687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=14 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:35.198475 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:35.198957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:35.199392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:35.200144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:35.200598 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:35.201045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:35.353715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:35.363906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:35.366119 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:35.367695 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0a37e919-cfc1-4e9f-a857-36981d1d4b3f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1720 microversion: 2.20 time: 0.181962 Aug 17 16:18:35.368522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 205/411] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:35 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:35.719841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-449830047", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "networks": [{"uuid": "ff9c0f00-70a4-4d5d-8327-ec34aa1fc348"}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:35.788723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] validate_networks() for [('ff9c0f00-70a4-4d5d-8327-ec34aa1fc348', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:18:35.836074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:35.837116 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:35.858402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:35.859414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:35.860112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:35.861160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:35.861885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:35.862526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:35.881658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:36.031315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.039926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-104e0b3d-bbf0-417c-9dd0-c49e2f86f181 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.208080 Aug 17 16:18:36.040859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 206/412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:35 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:36.054414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:36.055409 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:36.061811 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.062410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.062914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.063838 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.064652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.065099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.247656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.257110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-53065283-a5c5-412f-bb38-5021ba539e5f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.214806 Aug 17 16:18:36.258220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 207/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:36 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:36.391828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:36.392483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:36.399324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.399834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.400330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.401032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.402070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.402497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.521573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:18:36.522912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:18:36.523584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:18:36.524205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:18:36.525131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:18:36.537683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.538989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.540008 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.541065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.541747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.543035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.577351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Getting quotas for project 28896a54086b475eacbbc8bd55e2edc1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:36.582196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Getting quotas for user 4524f04719f54a1eb79e4590a86f8f92 and project 28896a54086b475eacbbc8bd55e2edc1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:36.588422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.599444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.600885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:18:36.601874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.603169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:18:36.603301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-625948a2-30a6-469e-a277-3d80321481b5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1723 microversion: 2.20 time: 0.215415 Aug 17 16:18:36.617696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 208/414] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:36 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:36.629530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "144fec97-d1c3-4ad0-9034-5710f734020d"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:36.631729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:36.638092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.638576 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.639272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.639707 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.640230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.640942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.661338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c6de0902-3c4b-45da-b0ad-b2d5da5674d1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947188 Aug 17 16:18:36.670584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 207/415] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:18:36.678151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-01185204-70d1-4acb-b862-40c3abd77911 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:36.678890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-01185204-70d1-4acb-b862-40c3abd77911 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:36.767357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-01185204-70d1-4acb-b862-40c3abd77911 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:36.777609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-01185204-70d1-4acb-b862-40c3abd77911 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1218 microversion: 2.1 time: 0.105125 Aug 17 16:18:36.778261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:36 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:36.788502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "name": "network-vif-unplugged", "status": "completed", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:36.801824 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:36.802302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:36.802725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:36.818465 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] Creating event network-vif-unplugged:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:18:36.823971 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-a1b350c9-55ef-4c72-a486-04dd3a7433f6 req-f1ca5772-18a3-4b83-bd5e-8550ce54a7a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043596 Aug 17 16:18:36.828906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 209/417] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:37.065390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:37.066351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:37.082532 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.084496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.085263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.086453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.087199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.088052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.139355 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a0800df2-680f-4202-a7d1-f29ae4d33330 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.514153 Aug 17 16:18:37.141117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 209/418] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 17 16:18:36 2022] POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments => generated 188 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:18:37.280269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:37.281003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:37.294931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.296874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.297614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.298892 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.306313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.309293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.483701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.491513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a1dd6f1b-aabf-4e12-a69e-999aa96295f7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.216701 Aug 17 16:18:37.492459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 210/419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:37 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:37.498253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:37.499066 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:37.505301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.505820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.506231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.506938 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.507409 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.507869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.556205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120793) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 16:18:37.636898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bf55a0ec-8759-4aa8-863c-28247d91a87a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/action" status: 202 len: 0 microversion: 2.20 time: 0.141556 Aug 17 16:18:37.638007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 211/420] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 17 16:18:37 2022] POST /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:18:37.646028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:37.646678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:37.650733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.654506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.655001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.655502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.656240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.656694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.657114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.659723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5e2fb187-7f3e-4731-b3d9-dcb51c973c9e tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1314 microversion: 2.1 time: 0.598870 Aug 17 16:18:37.660416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:37 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:37.798929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:37.799542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:37.801348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.806484 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.807283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.808302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.809481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:37.810191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:37.811039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:37.827260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.831527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.834473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-25823f13-deec-49e2-a071-51addb1f5e7d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1749 microversion: 2.20 time: 0.191151 Aug 17 16:18:37.835356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 212/422] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:37 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:37.953737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:37.963569 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f639624f-d1f5-4bbc-8343-701567e9c9ee tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1222 microversion: 2.1 time: 0.168476 Aug 17 16:18:37.965220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 211/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:37 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:38.514774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:38.515481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:38.522021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.522528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.523018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.523740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.524227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.524648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.680575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:38.681188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:38.691845 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.692542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.693205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.694129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.694778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.695571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.697810 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:38.711968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-02aae1c7-630d-49d2-a492-165b52194e17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.201462 Aug 17 16:18:38.712807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 213/424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:38 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:38.846691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "name": "network-vif-plugged", "status": "completed", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:38.852500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:38.857462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.858337 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.859139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.864430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-eca69d0d-361c-429e-a8e9-7e3e00da170c tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1498 microversion: 2.1 time: 0.187831 Aug 17 16:18:38.865088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 212/425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:38 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:38.874093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] Creating event network-vif-plugged:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:18:38.878398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-3e66ff9c-04ee-41d0-b96f-482d4c9813c9 req-7954e98f-3fad-4017-bcaf-2cba13fe9217 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035511 Aug 17 16:18:38.882346 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 214/426] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:38.882710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:38.883526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:38.892391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.892986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.893563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.897350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:38.898186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:38.898880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:38.987555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:38.988360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:38.999106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.000081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.001800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.003060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.003744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.004447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.053765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.065479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.067412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.071281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-668d114b-054f-4e81-8a81-7e50fb03e2bb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1749 microversion: 2.20 time: 0.193493 Aug 17 16:18:39.072529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 213/427] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:38 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:39.097386 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.113459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2d0cccc3-4cea-4773-a8e3-3fb19996bb70 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1270 microversion: 2.1 time: 0.130249 Aug 17 16:18:39.117971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 215/428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:38 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:39.572245 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:39.572702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:39.580329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.580823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.581259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.581966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.582426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.582855 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.615316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:18:39.699737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ff98ccb9-3d29-451b-9d29-03be4cfaafa6 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "DELETE /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 204 len: 0 microversion: 2.1 time: 0.131858 Aug 17 16:18:39.703730 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 214/429] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:18:39 2022] DELETE /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:18:39.709139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:39.710587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:39.719405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.720530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.721492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.723274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.723274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.723274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.735192 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:39.736039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:39.743791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.746057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.746787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.747726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:39.748289 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:39.748823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:39.879844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.888274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-82bed17a-29a4-41fb-9290-ebff58db5d10 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1504 microversion: 2.1 time: 0.183247 Aug 17 16:18:39.888842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 216/430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:39 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:39.944658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:39.954021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f550c61e-a0df-469f-aa01-656a0d5c3939 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.223052 Aug 17 16:18:39.954598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 215/431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:39 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:40.095514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:40.096266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:40.102372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.102855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.103288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.104018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.104634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.105112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.134669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:40.136511 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:40.154645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.155132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.155565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.156316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.156959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.157395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.247148 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:40.256868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f6ae2eec-7f68-4ab1-b19a-ff7299bfd4d4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1276 microversion: 2.1 time: 0.126155 Aug 17 16:18:40.257895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 216/432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:40 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:40.268141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:40.276654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:40.278160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:40.279419 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b6f36298-f4b8-484f-a0a4-2be27e3cbef8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1751 microversion: 2.20 time: 0.188277 Aug 17 16:18:40.280033 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 217/433] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:40 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:40.909718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:40.910336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:40.916969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.917622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.917953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.918649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.919101 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.919525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.976351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:40.976964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:40.983252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.983744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.984213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:40.984912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:40.985370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:40.985818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:41.060599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.068032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a9f4f250-dc63-40d8-a4cc-eaee4949670d tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1504 microversion: 2.1 time: 0.162349 Aug 17 16:18:41.068599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 217/434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:40 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:41.123789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.131147 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6774345d-24b3-442c-a523-2a8730fa6cb9 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.158983 Aug 17 16:18:41.131706 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 218/435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:40 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:41.279958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:41.281225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:41.288578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:41.289060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:41.289492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:41.290185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:41.290634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:41.291047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:41.304280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:41.304878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:41.311556 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:41.312045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:41.312472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:41.313147 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:41.313589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:41.314017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:41.436723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.444184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-29b1652a-54f3-4bb0-8779-5352027c05e2 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.169564 Aug 17 16:18:41.444768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 218/436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:41 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:41.461446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.470833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.472375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:41.473803 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4eed00d8-a254-4d55-8d43-9817f7c29dc0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1751 microversion: 2.20 time: 0.173144 Aug 17 16:18:41.474357 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 219/437] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:41 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:42.089661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:42.090250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:42.096754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.097241 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.097689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.098378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.099096 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.099519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.153480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:42.154233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:42.160046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.160527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.160959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.161640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.162092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.162512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.165273 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:42.299279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.306880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-15511169-195f-48ed-8207-8a170765c3d7 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1370 microversion: 2.1 time: 0.158002 Aug 17 16:18:42.308124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 220/438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:42 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:42.365738 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.373944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e973f7f0-363e-45d8-9ff2-ead1314e03a4 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1504 microversion: 2.1 time: 0.288596 Aug 17 16:18:42.374515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 219/439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:42 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:42.466347 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:42.466958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:42.473220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.473957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.474381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.475064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.475509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.475967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.498122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:42.498744 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:42.507394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.508103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.508915 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.509619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.510066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.510709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.626721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.639419 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e21450cf-6dc3-4c66-ab4d-26e3906995d8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.174194 Aug 17 16:18:42.640351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 221/440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:42 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:42.792200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.800698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.802225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:42.803392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-59d4b3b8-a283-4747-b524-c84b427aa44b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1751 microversion: 2.20 time: 0.309982 Aug 17 16:18:42.804037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 220/441] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:42 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1751 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:42.852313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6329b28-22e9-4612-9f0f-3a816805bcdd", "tag": "1d130e55-1982-460c-ba23-75e013537bb2"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:42.864933 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:42.865509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:42.866027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:42.882358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] Creating event network-changed:1d130e55-1982-460c-ba23-75e013537bb2 for instance e6329b28-22e9-4612-9f0f-3a816805bcdd on hv-cinder-85220 Aug 17 16:18:42.889942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-ef87905a-8803-40f5-a9c7-dd7d192691ab req-6ab13b0b-2472-4825-a2e1-45daf647e8d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044115 Aug 17 16:18:42.890801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 222/442] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:43.328858 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:43.329564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:43.336125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.336616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.337058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.337758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.338216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.339311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.342251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:43.395376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:43.396334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:43.406192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.406681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.407118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.407864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.408330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.408756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.473885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:43.482682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-be38a01d-8b87-45d9-954d-719bb43aec77 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1462 microversion: 2.1 time: 0.091457 Aug 17 16:18:43.483422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 223/443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:43 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:43.515190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:43.522736 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cd9bfbb2-45f9-4622-bd80-4c9d91c2c0d8 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1563 microversion: 2.1 time: 0.197901 Aug 17 16:18:43.523308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 221/444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:43 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:43.543036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:43.543502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:43.550886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.551375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.551831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.552531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.552987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.553410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.638350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b653e747-abeb-4bae-b678-ce3f9b1f257c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099236 Aug 17 16:18:43.638936 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 224/445] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:18:43 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:43.661989 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:43.662706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:43.670863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.676868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.678215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.679904 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.681309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.681806 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.826930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:43.827594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:43.842199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.842696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.843333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.844022 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:43.844480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:43.844901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:43.919230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:43.927945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e6e5c45d-d615-4374-88de-5a9e1bd60d00 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.270465 Aug 17 16:18:43.928528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 222/446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:43 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:44.305447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:44.317599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:44.319468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:44.320762 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3f9433dc-5ab8-46eb-9113-4d80c6a0803c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.498178 Aug 17 16:18:44.321320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 225/447] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:43 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:44.508614 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:44.509229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:44.515783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.516310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.516733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.517460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.517911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.518334 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.557258 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.557746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.558181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.558807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lazy-loading 'fault' on Instance uuid 92340ec7-7065-4256-a989-a013b7a7dd57 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:18:44.949462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92340ec7-7065-4256-a989-a013b7a7dd57", "name": "network-vif-deleted", "tag": "aa3dad7a-f5b4-464f-838c-cb99dd6fc98a"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:44.952531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945c8c54cb14c0da00b647663278410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cd27d906cc4496bdeaf929ff4ec21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:44.960012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-25fd38c8-3d0d-4bfb-ad3b-a4f661e9e907 tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 200 len: 1304 microversion: 2.1 time: 0.455153 Aug 17 16:18:44.960936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 223/448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:44 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 1304 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:44.966913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.967442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:44.967628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.968084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:44.968495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.974781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.975259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.975695 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.976423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:44.976874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:44.977295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:44.985351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] Creating event network-vif-deleted:aa3dad7a-f5b4-464f-838c-cb99dd6fc98a for instance 92340ec7-7065-4256-a989-a013b7a7dd57 on hv-cinder-85220 Aug 17 16:18:44.992560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-94e51cce-8ab3-48fa-b31f-081af2b3d1f7 req-722f7748-f427-4146-9a95-ef0403ba2c10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051905 Aug 17 16:18:44.997308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 226/449] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:45.096442 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:45.108979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:45.109876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:45.110470 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:45.127241 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] Creating event network-changed:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:18:45.132415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-3b4f8425-c8bd-4d97-af50-91c133f86866 req-b093b12d-a4a4-4df3-90a1-c6208e2f9610 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040487 Aug 17 16:18:45.133231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 227/450] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:18:45.213237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:45.225990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f0d20fbd-585a-4589-8435-151d4af4dd87 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.263732 Aug 17 16:18:45.227054 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 224/451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:44 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:45.352155 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:45.355528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:45.364392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:45.365183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:45.365804 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:45.366715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:45.368483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:45.369791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:45.597054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:45.606705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:45.608987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:45.610371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4402fff2-be42-4fb9-b9c7-2529fbb3ce6e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.266454 Aug 17 16:18:45.610940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 228/452] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:45 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:45.985612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:45.989491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] [instance: 92340ec7-7065-4256-a989-a013b7a7dd57] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:45.992853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:45.993346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:45.993779 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:45.994478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:45.995272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:45.995924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:46.012703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] HTTP exception thrown: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Request method failure captured: Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 HTTP/1.1 Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RSotTg9EhLK0Fp0GO4NLHQZaJX6qjY-73_bS6fZMpMi2-ENYApDcJdjlO5DcNJpINhde8oGKR-Mt3RZ3Mq7wirSlcz6i3BhEi3RUkFVrMQ4DIj-VRnwtVmHrGHy5cXXoQu68cpDMvj4FLMCYGf5kzWsBkiIRo0CXPARptKSdEvUn7o Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 07cd27d906cc4496bdeaf929ff4ec21e Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:18:46.014412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_07cd27d906cc4496bdeaf929ff4ec21e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/07cd27d906cc4496bdeaf929ff4ec21e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 07cd27d906cc4496bdeaf929ff4ec21e Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesActionsTest-1388250773 Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesActionsTest-1388250773-project Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: f945c8c54cb14c0da00b647663278410 Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesActionsTest-1388250773-project Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. Aug 17 16:18:46.015962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '92340ec7-7065-4256-a989-a013b7a7dd57'} Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:18:46.017106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. Aug 17 16:18:46.018565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:18:46.019658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] Returning 404 to user: Instance 92340ec7-7065-4256-a989-a013b7a7dd57 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:18:46.019658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d5d24582-654d-4d08-bd69-512db8e738eb tempest-VolumesActionsTest-1388250773 tempest-VolumesActionsTest-1388250773-project] 10.222.0.60 "GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57" status: 404 len: 111 microversion: 2.1 time: 0.034392 Aug 17 16:18:46.019658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 225/453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:45 2022] GET /compute/v2.1/servers/92340ec7-7065-4256-a989-a013b7a7dd57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:18:46.263185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:46.264024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:46.271027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:46.271711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:46.272400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:46.273413 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:46.274177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:46.274854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:46.450843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:46.458597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-20465b87-536c-4ce6-8383-4db9dbdd76e4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.199579 Aug 17 16:18:46.459978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 229/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:46 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:46.635248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:46.636663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:46.638517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:46.643846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:46.644599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:46.645523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:46.646626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:46.647239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:46.648019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:46.775492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=18 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:46.981234 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:46.992741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:46.995574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:46.997398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bd4fc5b4-7fe8-4a49-8b60-40a0cd317209 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.366060 Aug 17 16:18:46.997968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 226/455] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:46 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:47.480277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:47.480987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:47.487434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:47.487877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:47.488310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:47.489028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:47.489478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:47.489898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:47.645031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:47.652896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-22a278f0-2b96-4c2e-ab85-deb11708c4d0 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.177515 Aug 17 16:18:47.653474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 230/456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:47 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:48.022384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:48.022996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:48.030084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:48.030556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:48.030996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:48.031681 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:48.032183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:48.032607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:48.162922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:48.172130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:48.173674 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:48.174832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ec74d9f0-bb08-4d5e-a838-bc37281ad7e5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.156332 Aug 17 16:18:48.175387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 227/457] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:48 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:48.673622 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:48.674192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:48.680283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:48.680757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:48.681189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:48.681872 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:48.682925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:48.683375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:48.809875 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:48.817656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-33a20fff-ef12-4226-9753-9231e3d8934e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.147948 Aug 17 16:18:48.818220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 231/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:48 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:49.197711 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:49.198477 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:49.206379 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.207457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.208268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.209305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.209979 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.210768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.364866 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:49.374593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:49.376137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:49.377726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a1d413be-ca36-4a1e-a807-12e961a6484e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.183745 Aug 17 16:18:49.378419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 228/459] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:49 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:49.831404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:49.833957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:49.838245 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:49.838932 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:49.840149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.840637 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.843862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.843862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.843862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.843862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.844850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.845509 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.846105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.848346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.848346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.848346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.928169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9ff6cd80-dd39-44b1-9c7f-3160e91264dd tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action" status: 202 len: 0 microversion: 2.1 time: 0.100193 Aug 17 16:18:49.931888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 232/460] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:18:49 2022] POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:18:49.938671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:49.939629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:49.946501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.947001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.947435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:49.948763 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:49.949383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:49.949807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:50.025580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:50.036613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fdccd744-626f-475a-926e-1a7e31ac97c4 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.202015 Aug 17 16:18:50.052665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 229/461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:49 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:50.134774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:50.143259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7df0fd08-a75a-4aed-b11b-1163a988a62a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.209091 Aug 17 16:18:50.144051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 233/462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:49 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:50.406985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:50.408357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:50.415476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:50.416750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:50.418172 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:50.419102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:50.419737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:50.420349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:50.564282 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:50.575574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:50.577111 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:50.578273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d75be444-3fa4-44c0-b982-e001d3098338 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.178434 Aug 17 16:18:50.578817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 230/463] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:50 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:51.059777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:51.060508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:51.066674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.067162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.067595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.068319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.068772 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.069193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.166975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:51.167815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:51.174159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:51.176675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.177599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.178170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.179014 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.179539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.180062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.233534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:51.241833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c0556d2e-4e0f-4e5b-a88f-ef64360758f9 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.186814 Aug 17 16:18:51.242776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 234/464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:51 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:51.373277 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:51.381480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f848fb17-172b-464f-8ef7-be5ef435d6ec tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.218314 Aug 17 16:18:51.382236 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 231/465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:51 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:51.601595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:51.602230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:51.605805 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:51.609291 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.609774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.610204 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.610883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:51.611332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:51.611748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:51.785354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:51.799154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:51.800696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:51.802263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8a1fef43-90bc-4456-9e70-af7217aed2a3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.204818 Aug 17 16:18:51.803284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 235/466] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:51 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:52.121698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6329b28-22e9-4612-9f0f-3a816805bcdd", "name": "network-vif-plugged", "status": "completed", "tag": "1d130e55-1982-460c-ba23-75e013537bb2"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:52.156314 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.156812 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.157247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.191826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] Creating event network-vif-plugged:1d130e55-1982-460c-ba23-75e013537bb2 for instance e6329b28-22e9-4612-9f0f-3a816805bcdd on hv-cinder-85220 Aug 17 16:18:52.206074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-97e9c916-7d08-47e4-aa90-a74e92cd6fdb req-06e1cc04-6dbb-45ea-8022-6ec032859f5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095031 Aug 17 16:18:52.207108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 232/467] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:18:52.266111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:52.266827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:52.274604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.275269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.276299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.277371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.278545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.279152 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.423722 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:52.425601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:52.442672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.443454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.447327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.448397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.449188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.449782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.468674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:52.482140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2870e2cf-f19e-4196-a757-15d23a6028a8 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.218873 Aug 17 16:18:52.483640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 236/468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:52 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:52.775675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:52.787624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bbddca8d-650e-49d6-bab0-620faa681830 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.386873 Aug 17 16:18:52.788796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 233/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:52 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:52.841798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:52.842691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:52.850031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.850961 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.851679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:52.852648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:52.853363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:52.854079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:53.154813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:53.176516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:53.178514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:53.180122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7afc75cf-88fc-4c9c-9d94-ff9353e24b22 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.358151 Aug 17 16:18:53.195969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 237/470] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:52 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:53.504073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:53.504868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:53.513204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:53.513699 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:53.514129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:53.514834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:53.515470 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:53.516071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:53.678049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:53.690824 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-24e9c262-9ce7-49c9-a534-10aef6e21483 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.190801 Aug 17 16:18:53.691475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 234/471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:53 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:53.818690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:53.820504 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:53.840060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:53.840598 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:53.842240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:53.842985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:53.843737 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:53.844443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:53.848683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:54.171600 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:54.186293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-34a028d5-6fda-40d1-bfb8-0db499330861 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.376944 Aug 17 16:18:54.201205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 238/472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:53 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:54.206883 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:54.206883 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:54.218376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:54.219474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:54.220297 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:54.223295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:54.224621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:54.225287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:54.530920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:54.540969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:54.543493 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:54.544902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b8780f6c-c237-4224-93a5-027f5b98b0a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.344169 Aug 17 16:18:54.566246 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 235/473] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:54 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:54.717047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:54.718259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:54.730771 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:54.731561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:54.732354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:54.733244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:54.733859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:54.734557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:54.922606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:54.934126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2bbeb620-588b-44c7-aa55-5987c1f37fe7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.224238 Aug 17 16:18:54.947245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 239/474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:54 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:55.215940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:55.216854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:55.223170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.223947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.224378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:55.225068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.225744 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.226158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:55.424758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:55.436436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-01e5cefe-507e-4b23-9e0f-a6320f8a37a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.225426 Aug 17 16:18:55.436902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 236/475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:55 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:55.569440 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:55.570876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:55.590220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.591082 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.599890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:55.600740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.601410 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.602400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:55.799795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:55.814226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:55.819324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:55.823597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-96346018-ec6e-495d-8dcd-f7f47695fe5e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.256802 Aug 17 16:18:55.825837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 240/476] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:55 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:55.956114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:55.957100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:55.974878 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.977346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.977795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:55.981420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:55.985727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:55.986648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:56.188405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1611672171", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-965676027", "security_groups": [{"name": "tempest-secgroup-smoke-503595786"}], "block_device_mapping_v2": [{"uuid": "4abcde86-c526-4080-ab23-b2e78ede5ebb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6a03044-b6d5-4e67-9b08-ead35b439913"}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:18:56.264089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:56.294721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-113cfbd3-3d93-436b-9f6a-8c1f7d3bcc1a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.343471 Aug 17 16:18:56.296436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 237/477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:55 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:56.397263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] validate_networks() for [('f6a03044-b6d5-4e67-9b08-ead35b439913', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:18:56.457718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:56.458673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:56.475371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:56.484801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:56.487305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:56.492098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:56.493069 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:56.497493 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:56.706727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:56.709163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:56.718314 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-813b35c8-e85c-426a-b1de-8894f701bae4 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.264859 Aug 17 16:18:56.731418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 238/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:56 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:18:56.861834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:56.862846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:56.870025 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:56.876091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:56.876691 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:56.877609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:56.879309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:56.879844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.093836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:18:57.094873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:18:57.095640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:18:57.096484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:18:57.097163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:18:57.116804 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.120036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.121002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.125671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.128473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.128473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.177396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:18:57.183213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for user 2f7f4cf57e814aebab32a56b19aa067f and project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:18:57.323650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:18:57.325926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4abcde86-c526-4080-ab23-b2e78ede5ebb',volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:18:57.393954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:57.407879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:57.420440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:57.423890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e77bbbac-d94e-4267-a89c-84ef8c5a8ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.566205 Aug 17 16:18:57.424564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 239/479] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:56 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:18:57.437855 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:57.438570 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:57.463964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.464377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.464684 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.469440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.470092 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.470756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.748940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e27ed9b0-42df-45ad-9877-388bd09335bf tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.564543 Aug 17 16:18:57.757167 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 241/480] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:18:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:18:57.763720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:57.764591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:57.782500 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.782992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.783434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.784165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:57.785045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:57.785045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:57.956934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:57.966646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-174c6b09-17a6-46f1-82c2-4aaa48312e8c tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.539449 Aug 17 16:18:57.969348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 240/481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:57 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:57.981438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8e582570-db72-4777-bf23-2db2f165d212 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:57.984160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8e582570-db72-4777-bf23-2db2f165d212 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:58.065955 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8e582570-db72-4777-bf23-2db2f165d212 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:58.074357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8e582570-db72-4777-bf23-2db2f165d212 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1094 microversion: 2.1 time: 0.100619 Aug 17 16:18:58.075099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 241/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:57 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:58.167826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:58.182688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fc6a15e7-b160-4035-8803-ec42e5b61893 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.423427 Aug 17 16:18:58.184010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 242/483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:57 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:58.454448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:58.455942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:58.464669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:58.465669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:58.466480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:58.467471 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:58.468186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:58.468819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:58.747221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:58.763975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:58.767510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:58.769772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d1bfd400-a974-4ce5-94f1-c5b64d9e45df tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.319264 Aug 17 16:18:58.790299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 242/484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:58 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:18:59.007869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:59.009178 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:59.017223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.017713 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.018147 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.018866 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.019327 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.019754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.096449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:59.096964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:59.109525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.111665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.111665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.111908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.116549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.118388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.210996 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.222276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7285019d-ba38-45ba-8f7f-29cfc963a23a tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.227784 Aug 17 16:18:59.223724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 243/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:58 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:59.229165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:59.229968 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:59.240078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.240829 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.241429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.245768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.246542 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.247150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.247852 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.261817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cc0f876b-f749-40c2-9bb4-a698f5afcc8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1144 microversion: 2.1 time: 0.170014 Aug 17 16:18:59.263097 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 243/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:59 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1144 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:59.515636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.524577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-da8079e7-f529-43cb-83d1-279db6007e9a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.299242 Aug 17 16:18:59.525888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 244/487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:18:59 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:18:59.799051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:18:59.799653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:18:59.806291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.807430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.808022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.808813 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:18:59.809204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:18:59.809627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:18:59.954361 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.964837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.966353 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:18:59.967517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-135d7ddb-aa71-4143-8117-5922bd70d12d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.172956 Aug 17 16:18:59.979754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 244/488] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:18:59 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:00.250482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:00.251264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:00.259533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.260571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.261149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.262085 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.262662 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.263258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.283968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:00.285143 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:00.294560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.296263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.296910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.297843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.298301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.301533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.377215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:00.385794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-afbf90af-e77f-41c4-a8d0-38b09a7474ca tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1144 microversion: 2.1 time: 0.106742 Aug 17 16:19:00.391854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 245/489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:00 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:00.437753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:00.445591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c88e05f4-e3c1-4fcb-a595-c65d1b657f24 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.201474 Aug 17 16:19:00.446366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 245/490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:00 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:00.547151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:00.548177 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:00.557033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.557918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.558583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.559543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:00.560224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:00.560898 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:00.815982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:00.833908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f9674766-b7cf-46c5-8ba2-9d36605bf4cb tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.290599 Aug 17 16:19:00.836955 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 246/491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:00 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:00.995011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:00.995701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:01.001856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.002341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.002776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.003616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.004095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.004535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.148263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:01.157939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:01.159863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:01.161034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bca30965-bcf0-41c7-a71b-8d150600f9dd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.170672 Aug 17 16:19:01.161620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 246/492] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:00 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:01.409000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:01.409906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:01.423687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.429420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.430230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.430997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.431501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.432574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.467710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:01.468421 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:01.487237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.489375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.491645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.498784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.499709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.500534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.595841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:01.606708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ae4e74f5-169f-4826-8fe6-e45fe512277d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1136 microversion: 2.1 time: 0.202112 Aug 17 16:19:01.607844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 247/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:01 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1136 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:01.716303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:01.744137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cdd3a40b-7734-4c14-9f61-f3740a8ab8ad tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1318 microversion: 2.1 time: 0.280099 Aug 17 16:19:01.758983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 247/494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:01 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:01.857836 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:01.858652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:01.865843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.866320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.866755 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:01.867506 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:01.868041 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:01.868464 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.056195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:02.068364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c0a22d7c-1c42-464e-9e53-51747b42f2e9 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1751 microversion: 2.1 time: 0.215678 Aug 17 16:19:02.069295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 248/495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:01 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:02.186818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:02.187186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:02.193664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.194461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.194975 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.195941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.196649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.197188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.341221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:02.353175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:02.355987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:02.357342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6c5810f8-719f-4480-91f9-727498077f47 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.176528 Aug 17 16:19:02.358224 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 248/496] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:02 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:02.628224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:02.629306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:02.636987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.637769 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.638596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.639398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.639947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.640436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.720999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:02.741485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ca1746b8-157f-409f-9485-eacc35e78f2d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1200 microversion: 2.1 time: 0.117203 Aug 17 16:19:02.742321 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 249/497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:02 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:02.766827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:02.768024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:02.794305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.798081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.799266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:02.803444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:02.806172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:02.807497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.026817 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:03.037757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5926a443-10b7-48dd-8bec-e4c2c21a52ba tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1506 microversion: 2.1 time: 0.276195 Aug 17 16:19:03.038440 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 249/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:02 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:03.091100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:03.094209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:03.107594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.110233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.112997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.114462 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.115305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.116003 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.381409 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:03.382528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:03.399684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.401302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.402372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.403731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.406056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.406799 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.437390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:03.451458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-98b53250-a20b-46c5-88f8-94c6d4115fa8 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.364875 Aug 17 16:19:03.468837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 250/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:03 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:03.645922 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:03.662868 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:03.664856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:03.668774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d4f25194-8fb9-4bcd-982f-2f914909efa9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.290394 Aug 17 16:19:03.670240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 250/500] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:03 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:03.767051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:03.768042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:03.780794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.781977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.783560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:03.786273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:03.787016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:03.787656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:04.103469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:04.118352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-78b74c15-d148-4e9b-ac45-3da5aae0c970 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1210 microversion: 2.1 time: 0.354709 Aug 17 16:19:04.133787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 251/501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:03 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1210 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:04.474765 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:04.475372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:04.482047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:04.482731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:04.483377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:04.484091 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:04.484539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:04.485168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:04.695453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:04.696825 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:04.698358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:04.706828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-85b71b55-a337-4ac3-afe5-d4a3b9c918f0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.235465 Aug 17 16:19:04.714377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:04.715233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:04.715944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:04.716891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:04.724214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:04.724661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:04.725539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 251/502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:04 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:04.982945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:04.992572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:04.994293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:04.995518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cb5ea537-2202-47ed-a874-d96195346bb4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.303107 Aug 17 16:19:04.996252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 252/503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:04 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:05.140932 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:05.141887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:05.152552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:05.153149 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:05.154550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:05.155461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:05.156246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:05.156930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:05.311666 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:05.317395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7b5e26-05a5-4931-9022-7bf936165fef", "tag": "20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:05.335189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:05.335881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a865ca34-40b3-4f7a-a542-20df2c6728c5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.198761 Aug 17 16:19:05.336468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:05.337133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:05.341098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 252/504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:05 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:05.354521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] Creating event network-changed:20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30 for instance 6f7b5e26-05a5-4931-9022-7bf936165fef on hv-cinder-85220 Aug 17 16:19:05.361889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-a6d3e2a2-cf9e-4a47-b6df-3da3d7e60a90 req-575021c2-ec21-497a-b654-3c7e46b8d054 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048285 Aug 17 16:19:05.363267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 253/505] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:19:05.733183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:05.733808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:05.741345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:05.743627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:05.744573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:05.746146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:05.746840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:05.747332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:05.947353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:05.955989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-924bef2b-2103-4ef3-b959-d0548688ec03 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.229278 Aug 17 16:19:05.956775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 253/506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:05 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:06.020790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:06.021409 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:06.030116 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.030627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.031061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:06.031784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.032438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.032849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:06.179569 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:06.188669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:06.190224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:06.191417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-93adb21f-220a-4c62-bcd3-bc739bd549c3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.175273 Aug 17 16:19:06.192016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 254/507] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:06 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:06.362723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:06.363341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:06.370486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.371732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.371732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:06.372198 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.372625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.373014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:06.602155 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:06.610833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d8c7ed7e-e486-4504-98c6-04b83527af59 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.251917 Aug 17 16:19:06.611452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 254/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:06 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:06.977365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:06.979998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:06.987465 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.988071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.988789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:06.989653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:06.990262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:06.990871 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:07.199714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:07.207789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9f323757-52ad-4f49-bbac-d09906554def tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.234649 Aug 17 16:19:07.227038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:07.228843 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:07.231871 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:07.232517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:07.232973 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 255/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:06 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:07.238366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:07.238850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:07.239283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:07.240014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:07.240469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:07.240885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:07.259169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:07.397587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:07.406438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:07.408005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:07.409165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2d7477a1-619a-4e27-8f8d-2c42f0a93ee2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.188234 Aug 17 16:19:07.409728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 255/510] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:07 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:07.631719 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:07.632367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:07.638806 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:07.639457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:07.640190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:07.641139 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:07.641814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:07.642466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:07.800385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:07.809023 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c944a158-7e23-439e-a803-d461a4292a4d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.181122 Aug 17 16:19:07.809944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 256/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:07 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:08.233595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:08.234208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:08.240739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.241223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.241898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.242543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.243164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.243589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.394958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:08.404837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6e8e1218-56f8-4cf4-bdd7-f5ccb93d1f31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.175070 Aug 17 16:19:08.405792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 256/512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:08 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:08.435064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:08.435664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:08.438062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:08.450272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.450763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.451277 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.452135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.452630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.453147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.456430 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:08.606149 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:08.614869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:08.616463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:08.617646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-628ce708-6a42-4180-bf27-4ac54504d2d2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.187705 Aug 17 16:19:08.618209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 257/513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:08 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:08.832253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:08.833154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:08.841716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.842219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.842703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.843516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:08.844076 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:08.844964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:08.991408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:09.000766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d138e782-2d99-460f-8688-0d989e20bfed tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.173550 Aug 17 16:19:09.001339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 257/514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:08 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:09.428301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:09.429077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:09.436191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:09.436815 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:09.437272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:09.438050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:09.438741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:09.439368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:09.603679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:09.613266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1fdc33f1-9d01-4a6c-87bd-294f5255ed31 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.188885 Aug 17 16:19:09.613851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 258/515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:09 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:09.644941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:09.645551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:09.653094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:09.653567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:09.653996 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:09.654686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:09.655132 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:09.655544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:09.792002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:09.800702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:09.802217 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:09.803371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c8144299-642b-45d5-836d-c76c035ff742 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.162530 Aug 17 16:19:09.804233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 258/516] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:09 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:10.023113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:10.023887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:10.035833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.036828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.037336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.038144 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.038601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.039270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.212226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:10.221772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ba0b67bd-d1b9-466d-a023-55e7621885c0 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.203238 Aug 17 16:19:10.222351 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 259/517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:10 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:10.636416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:10.637381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:10.644180 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.644989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.645808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.646162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.646868 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.647538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.820924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:10.829482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:10.831223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:10.844049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4ef68402-017d-4946-9001-b44e9028b1d5 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.211947 Aug 17 16:19:10.844911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.848486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.848829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.849544 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:10.849997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:10.852018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:10.859949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 259/518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:10 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:10.992811 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:11.001856 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:11.003616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:11.004840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4c4a6aae-9d8b-48ff-891c-b306fc92a000 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.179630 Aug 17 16:19:11.005394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 260/519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:10 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:11.244487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:11.245092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:11.251180 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:11.251787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:11.252253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:11.252958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:11.253415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:11.254037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:11.401531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:11.409908 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e105ef21-85d4-4220-ac9e-b42650d0c198 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.169851 Aug 17 16:19:11.410481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 260/520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:11 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:11.866751 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:11.867507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:11.875004 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:11.875497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:11.875969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:11.876704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:11.877169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:11.877598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.029045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:12.029710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:12.038153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:12.038648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:12.039080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.039787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:12.040258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:12.040760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.053765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:12.063085 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a174d939-48c6-4043-85f0-961f994c0d20 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.200240 Aug 17 16:19:12.064262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 261/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:11 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:12.126425 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "name": "network-vif-plugged", "status": "completed", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:12.138545 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:12.139039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:12.139662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.157126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] Creating event network-vif-plugged:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:19:12.179485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-b26b5833-06ac-4c83-91b3-8f454e0e42a2 req-72375026-7a78-48ff-a818-1428979358ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057144 Aug 17 16:19:12.180402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 262/522] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:19:12.239182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:12.251666 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:12.253245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:12.254407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-62e746d4-a872-4909-8f2a-987dbda51c1f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.229642 Aug 17 16:19:12.255277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 261/523] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:12 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:12.436371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:12.437521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:12.443958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:12.444523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:12.445189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.446413 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:12.447088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:12.447712 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:12.607599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:12.615427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-86d7d9c2-c40a-444a-ac57-b850c7ab7896 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.185548 Aug 17 16:19:12.616013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 263/524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:12 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:13.090428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:13.090986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:13.097117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.097602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.098046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.099030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.099486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.099941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.242059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:13.250425 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-51bb65c5-7c78-4f33-9856-7d28fceacf3e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.164426 Aug 17 16:19:13.250999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 262/525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:13 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:13.279237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:13.279861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:13.286209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.286681 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.287109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.287785 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.288255 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.288702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.424485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:13.434400 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:13.435937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:13.437123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cc926dba-4fd4-48ae-b3e6-ffb2bac2aeaf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.162654 Aug 17 16:19:13.437707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 264/526] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:13 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:19:13.637797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:13.638336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:13.644309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.644786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.645214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.645894 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:13.646342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:13.646761 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:13.779758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:13.787490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4c610077-a6e3-43f7-a09f-f99ba1d3a7c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.154289 Aug 17 16:19:13.788097 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 263/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:13 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:14.272467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:14.273077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:14.279503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.280171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.280425 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.281117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.281574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.281990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.459285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:14.461393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:14.463098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:14.468698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f6c8a80b-948b-4677-aca0-4b1580f4d34f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.199940 Aug 17 16:19:14.469419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 265/528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:14 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:14.471526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.472557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.478727 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.479499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.480101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.480472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.628565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:14.639012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:14.641301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:14.642575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-42107803-0df9-45fd-8af9-5f68d0a1182c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.186088 Aug 17 16:19:14.643123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 264/529] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:14 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:14.807787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:14.808424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:14.815504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.816033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.816466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.817166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:14.817616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:14.818037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:14.959638 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:14.968041 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d4b4194f-6ad4-4a2a-9257-ca289f542188 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.164130 Aug 17 16:19:14.968617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 266/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:14 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:15.494617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:15.495221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:15.501179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:15.501661 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:15.502094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:15.502787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:15.503243 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:15.503672 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:15.659772 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:15.665925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:15.667403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:15.669162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a44d5941-f310-453b-ae57-a14ed13450b0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.178588 Aug 17 16:19:15.669733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 265/531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:15 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:15.674060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:15.674538 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:15.674969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:15.675661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:15.676216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:15.676636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:15.832236 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:15.843613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:15.845566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:15.846875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3fd179db-7645-42c8-bc87-db9b0ea9dca2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1807 microversion: 2.20 time: 0.185195 Aug 17 16:19:15.847437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 267/532] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:15 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:16.001236 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:16.002737 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:16.011992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.013484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.014181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.015276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.015963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.016681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.123580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7b5e26-05a5-4931-9022-7bf936165fef", "name": "network-vif-plugged", "status": "completed", "tag": "20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:16.134551 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.135662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.136279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.148449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] Creating event network-vif-plugged:20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30 for instance 6f7b5e26-05a5-4931-9022-7bf936165fef on hv-cinder-85220 Aug 17 16:19:16.154223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-7763f565-4995-497e-b71c-4abbc23d8518 req-47410317-89df-4279-8b81-61cca47e4967 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037007 Aug 17 16:19:16.155026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 268/533] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:19:16.195628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:16.217143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9fbce293-4ff6-41ff-8f70-9c1b395fada5 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.231714 Aug 17 16:19:16.229133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 266/534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:15 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:16.692230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:16.692931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:16.699184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.701349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.701820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.702546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.703003 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.703429 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.871143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:16.871755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:16.874458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:16.878457 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.878937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.879555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.880284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:16.880737 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:16.881161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:16.882402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-93ea7aac-4037-4b81-b084-2fdcd5620f7f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.194822 Aug 17 16:19:16.883525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 269/535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:16 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:17.036795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:17.046152 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:17.048379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:17.049567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4abb17e2-b55b-42c6-a5f8-fa37d66e0939 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1794 microversion: 2.20 time: 0.183266 Aug 17 16:19:17.050127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 267/536] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:19:16 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1794 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:19:17.238708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:17.239319 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:17.246192 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:17.246868 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:17.247377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:17.248196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:17.248828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:17.249329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:17.394146 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:17.402558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e9a036ad-3c55-48f0-b87b-5d6c2496f11c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.167871 Aug 17 16:19:17.403215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 270/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:17 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:17.905623 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:17.906227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:17.912592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:17.913084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:17.913518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:17.914223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:17.914674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:17.915566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:18.083053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:18.092154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-02caca1e-02b6-4ca9-ae2d-a493348782a1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.190279 Aug 17 16:19:18.093025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 268/538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:17 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:18.423968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:18.424701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:18.431076 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:18.431560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:18.432018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:18.432703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:18.433156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:18.433576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:18.575460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:18.585321 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b9a3f0da-abe8-4b5b-afdc-30ce5ee9d06f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1265 microversion: 2.1 time: 0.165132 Aug 17 16:19:18.586434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 271/539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:18 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:19.114423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:19.115025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:19.121925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.122403 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.122828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.123502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.124012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.124428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.278715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:19.287327 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-85ddbb1b-6b18-4e53-9bc4-0ee74b0c51b7 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.177027 Aug 17 16:19:19.287944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 269/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:19 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:19.606673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:19.607285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:19.613769 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.614247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.614679 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.615365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.615840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.616266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.752630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:19.761056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6f006a34-457a-4017-a368-c15d67d8460b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1452 microversion: 2.1 time: 0.158431 Aug 17 16:19:19.761627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 272/541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:19 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:19.780885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:19.781495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:19.787899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.788389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.788822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.789775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:19.790450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:19.790915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:19.932446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:19.940387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-baaa3fcf-48d3-4a90-8229-57f1184a4d5b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1452 microversion: 2.1 time: 0.163523 Aug 17 16:19:19.940990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 270/542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:19 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:20.310060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:20.310917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:20.319388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:20.320117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:20.320702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:20.322097 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:20.322578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:20.323108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:20.480437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:20.488931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4cdf80f5-bf6d-4aa3-b264-f6f0fa0129b6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.183454 Aug 17 16:19:20.489529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 273/543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:20 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:21.511833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:21.512505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:21.519824 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:21.520335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:21.520790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:21.521523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:21.522036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:21.522489 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:21.760178 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:21.768918 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-44993f8b-8ba4-4766-a414-d6d7c36ac1a3 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.261856 Aug 17 16:19:21.769488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 271/544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:21 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:22.094732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7b5e26-05a5-4931-9022-7bf936165fef", "tag": "20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:22.100469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=88 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:22.106693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:22.107262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:22.107765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:22.122068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] Creating event network-changed:20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30 for instance 6f7b5e26-05a5-4931-9022-7bf936165fef on hv-cinder-85220 Aug 17 16:19:22.127587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-d47c1a14-4cef-4c79-9bf0-581a907901f4 req-7d463df4-25cc-4a24-ba3c-efbcd099e4ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036234 Aug 17 16:19:22.128667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 274/545] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:19:22.793752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:22.794415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:22.796376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:22.806847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:22.807338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:22.807772 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:22.808496 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:22.808947 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:22.809369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:22.812689 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:22.998088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:23.007336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-752bb211-a876-44fb-81ac-db6a7d3b29ad tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.218922 Aug 17 16:19:23.008114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 272/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:22 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:19:24.035574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:24.036329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:24.043446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:24.043959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:24.044396 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:24.045086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:24.045539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:24.045966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:24.194257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:24.197125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:24.204212 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b57dfb17-bbbb-4de2-aacf-fbddc50b3d68 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1756 microversion: 2.1 time: 0.173347 Aug 17 16:19:24.204782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 275/547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:24 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:25.226034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:25.226636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:25.233353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:25.233822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:25.234255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:25.234962 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:25.235411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:25.235855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:25.383077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:25.392024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1c8429c9-0a49-445c-9545-ac12350cc4ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1759 microversion: 2.1 time: 0.170237 Aug 17 16:19:25.392784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 273/548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:25 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:19:26.062248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f0a2c3-de3e-45e0-ab92-cad6bc2dc563", "device": "/dev/sdb"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:26.065073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:26.071906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:26.072534 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:26.072993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:26.073700 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:26.074143 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:26.074556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:26.368520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-617a6e69-9b4e-463c-b931-97e033e08ef5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "POST /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309313 Aug 17 16:19:26.369342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 276/549] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:19:26 2022] POST /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:19:50.560212 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8807741a-753d-4f13-9751-818b59687059"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:50.562522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:50.564585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:50.565222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=11 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:50.571096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:50.571569 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:50.572038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:50.573220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:50.574020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:50.574444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:51.597043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1cb47719-aab7-4c39-a0fc-8993f47f16d0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.041205 Aug 17 16:19:51.598312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 274/550] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:19:50 2022] POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:19:53.176259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=5 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:53.177052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:53.182361 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:53.183342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:53.190706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:53.191181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:53.191608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:53.192311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:53.192760 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:53.193174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:53.319319 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lazy-loading 'services' on Instance uuid e6329b28-22e9-4612-9f0f-3a816805bcdd {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:19:53.432588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-856c58bd-f5bc-4e70-9be9-8aa75e20ca7f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd/os-volume_attachments/55f0a2c3-de3e-45e0-ab92-cad6bc2dc563" status: 202 len: 0 microversion: 2.1 time: 0.257065 Aug 17 16:19:53.433229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 277/551] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:19:53 2022] DELETE /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd/os-volume_attachments/55f0a2c3-de3e-45e0-ab92-cad6bc2dc563 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:19:59.121797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:19:59.124139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:59.130230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:59.130715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:59.131151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:59.131862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:59.132320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:59.132742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:59.155623 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lazy-loading 'flavor' on Instance uuid 6d5f23e7-06ad-4a94-992b-8d5a76ad345b {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:19:59.274627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-72a2c123-115e-498d-9c1f-2cd90375f0d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/action" status: 200 len: 32 microversion: 2.1 time: 0.158287 Aug 17 16:19:59.275140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 275/552] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:19:59 2022] POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:19:59.286075 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:19:59.286771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:19:59.293935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:59.294423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:59.294862 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:59.295562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:19:59.296059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:19:59.296486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:19:59.456995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:19:59.466299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3a3370eb-4766-44fc-95ac-9f4a76a799d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.184876 Aug 17 16:19:59.466952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 278/553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:19:59 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:00.489879 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:00.490579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:00.497503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:00.498040 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:00.498495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:00.499183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:00.499633 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:00.500084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:00.629192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:00.637068 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-730079e3-c2eb-40b8-8051-86f43e1d36e5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.151940 Aug 17 16:20:00.637621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 276/554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:00 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:00.908988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:00.909480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:00.915827 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:00.916954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:00.917387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:00.918073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:00.918521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:00.918939 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:00.942933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:20:01.019222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8a10dc8f-d91b-4602-8cd8-7aa9fb26a564 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 204 len: 0 microversion: 2.1 time: 0.113430 Aug 17 16:20:01.019952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 279/555] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:20:00 2022] DELETE /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:20:01.029102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:01.029708 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:01.036143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:01.036619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:01.037051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:01.037731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:01.038184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:01.038605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:01.173692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:01.181055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1e2a54bd-4b44-4b1b-b62e-9a315375323d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1512 microversion: 2.1 time: 0.156604 Aug 17 16:20:01.182222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 277/556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:01 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:01.658948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:01.659654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:01.665640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:01.666937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:01.667348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:01.668073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:01.668814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:01.669398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:01.802546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:01.810592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-405a1db3-0815-40da-b861-6037cb5ffaeb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.156042 Aug 17 16:20:01.811156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 280/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:01 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:02.203357 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:02.203999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:02.210441 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:02.210920 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:02.211348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:02.212070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:02.212527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:02.213077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:02.343622 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:02.351290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f2abb5fa-3a9c-4c20-b614-06f55f4aff03 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1512 microversion: 2.1 time: 0.151717 Aug 17 16:20:02.351859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 278/558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:02 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:02.832126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:02.832840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:02.839961 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:02.840446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:02.840873 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:02.841558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:02.842000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:02.842410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:02.990162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:02.998286 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-868ed85c-0d81-46b4-bbda-f6031138e2bd tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.170060 Aug 17 16:20:02.998851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 281/559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:02 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:03.372594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:03.373201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:03.380491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:03.381067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:03.381588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:03.382318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:03.382769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:03.383186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:03.519715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:03.528090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bfb4cff7-6d41-4a34-8540-7d7b32275cce tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 200 len: 1512 microversion: 2.1 time: 0.159641 Aug 17 16:20:03.528863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 279/560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:03 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:03.642615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6329b28-22e9-4612-9f0f-3a816805bcdd", "name": "network-vif-deleted", "tag": "1d130e55-1982-460c-ba23-75e013537bb2"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:03.653619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:03.654108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:03.654515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:03.666653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] Creating event network-vif-deleted:1d130e55-1982-460c-ba23-75e013537bb2 for instance e6329b28-22e9-4612-9f0f-3a816805bcdd on hv-cinder-85220 Aug 17 16:20:03.672345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-7329cf38-4944-437a-afb5-f6ccead3a16c req-ef05c16f-ea2b-4f0d-a0d1-d0a6ff07ae24 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Aug 17 16:20:03.672524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 282/561] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:04.019393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:04.020035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:04.026890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:04.027368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:04.027826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:04.028511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:04.028963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:04.029386 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:04.160214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:04.168491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f3b6698e-097e-40c1-bc9c-9ae5ffae9fab tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.152937 Aug 17 16:20:04.169049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 280/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:04 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:04.550912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:04.551523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: e6329b28-22e9-4612-9f0f-3a816805bcdd] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:04.558392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:04.558867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:04.559301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:04.560022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:04.560475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:04.560899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:04.574636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] HTTP exception thrown: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Request method failure captured: Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd HTTP/1.1 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RTZfaAKqcHxxvifvrdE44_Ou7F-p7NT3RWIv4K0obtbmkasJXTrrIlW1n6WGt3NcGyvWafddTwWdFIihytc6wN0dK2B-WUyWc-LPt7g3CPh0mWfDA7qT5c9zQyb-3ZRxQ3-liBz1nCwsvhzL-OLfWdOhXrSPyJTyrp_tv-FR49JLGU Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 28896a54086b475eacbbc8bd55e2edc1 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:20:04.576249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_28896a54086b475eacbbc8bd55e2edc1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 28896a54086b475eacbbc8bd55e2edc1 Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesSnapshotTestJSON-867474910-project Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 4524f04719f54a1eb79e4590a86f8f92 Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesSnapshotTestJSON-867474910-project Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. Aug 17 16:20:04.577754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'e6329b28-22e9-4612-9f0f-3a816805bcdd'} Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:04.578622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. Aug 17 16:20:04.580033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:04.581366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Returning 404 to user: Instance e6329b28-22e9-4612-9f0f-3a816805bcdd could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:04.581366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1bab0bcd-fa00-444a-b652-32106c3c805d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd" status: 404 len: 111 microversion: 2.1 time: 0.031739 Aug 17 16:20:04.581366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 283/563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:04 2022] GET /compute/v2.1/servers/e6329b28-22e9-4612-9f0f-3a816805bcdd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:20:05.189659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:05.190310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:05.196583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:05.197056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:05.197531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:05.198263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:05.198740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:05.199155 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:05.329282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:05.337170 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4a760447-44e2-408c-baf3-28ca43b58388 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.151294 Aug 17 16:20:05.338235 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 281/564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:05 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:06.360260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:06.360870 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:06.367253 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:06.367727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:06.368193 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:06.369447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:06.370063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:06.370482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:06.500178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:06.508069 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c56f2c30-5529-447c-90af-a958619aead5 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.151635 Aug 17 16:20:06.508630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 284/565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:06 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:07.529073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:07.529684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:07.536078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:07.536559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:07.536991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:07.537693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:07.538135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:07.538553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:07.666610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:07.674687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-64be3379-97ee-4678-bed9-eaa7f22b1802 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.149525 Aug 17 16:20:07.676411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 282/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:07 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:08.698643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:08.699260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:08.706139 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:08.706623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:08.707060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:08.707754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:08.708255 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:08.708668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:08.845348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:08.854465 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4a4808f5-fa8e-4582-b899-dc06c7c6c086 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.159886 Aug 17 16:20:08.855026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 285/567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:08 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:09.875842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:09.876455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:09.882820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:09.883320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:09.883745 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:09.885219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:09.885834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:09.886256 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:10.015029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:10.022855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-031985cb-1d37-4549-83bd-c5f5b6712e67 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.150910 Aug 17 16:20:10.023417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 283/568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:09 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:11.044105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:11.044851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:11.051312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:11.051787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:11.052241 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:11.052916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:11.053361 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:11.053775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:11.181680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:11.189628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-98794a6f-211a-4f62-b6ca-78ac34c335b2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.149655 Aug 17 16:20:11.190192 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 286/569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:11 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:12.211444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:12.212065 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:12.219242 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:12.219745 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:12.220201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:12.220880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:12.221326 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:12.221741 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:12.358166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:12.366071 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-55c22a72-ab4d-401c-b2af-a9094ae8bf96 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.158449 Aug 17 16:20:12.366634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 284/570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:12 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:13.387242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:13.387938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:13.394607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:13.395080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:13.395669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:13.396384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:13.396833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:13.397251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:13.434315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-753112419", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "networks": [{"uuid": "ff9c0f00-70a4-4d5d-8327-ec34aa1fc348"}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:13.488691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] validate_networks() for [('ff9c0f00-70a4-4d5d-8327-ec34aa1fc348', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:20:13.533940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:13.542691 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4fc7f737-5335-4bf1-bb5c-94ec5ea2467f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.160178 Aug 17 16:20:13.543252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 287/571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:13 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:13.842945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:20:13.843358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:20:13.843847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:20:13.844251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:20:13.844656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:20:13.853585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:13.854612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:13.855034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:13.855738 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:13.856215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:13.856633 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:13.873638 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Getting quotas for project 28896a54086b475eacbbc8bd55e2edc1. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:20:13.877470 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Getting quotas for user 4524f04719f54a1eb79e4590a86f8f92 and project 28896a54086b475eacbbc8bd55e2edc1. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:20:13.888250 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:20:13.890439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:20:13.935439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ec0d58a7-8792-4d7f-a82c-bd6681a0728e tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505474 Aug 17 16:20:13.936302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 285/572] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 16:20:13.946781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7e21c5e4-a6c8-4c8d-a9b6-d7a5c54c36be tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:13.947389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7e21c5e4-a6c8-4c8d-a9b6-d7a5c54c36be tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:14.002395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7e21c5e4-a6c8-4c8d-a9b6-d7a5c54c36be tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:14.009055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7e21c5e4-a6c8-4c8d-a9b6-d7a5c54c36be tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1218 microversion: 2.1 time: 0.065962 Aug 17 16:20:14.009620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 288/573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:13 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:14.564351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:14.564955 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:14.570954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:14.571430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:14.571886 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:14.573144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:14.573773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:14.574197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:14.709474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:14.717681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4f519ce4-750a-470e-a09d-80ea367f85ea tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.157755 Aug 17 16:20:14.718247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 286/574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:14 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:15.029822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:15.030440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:15.036736 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:15.037216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:15.037647 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:15.038337 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:15.038807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:15.039233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:15.103614 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:15.112074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-84762404-e998-46e0-8ba4-ba55242746c3 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1270 microversion: 2.1 time: 0.086598 Aug 17 16:20:15.124394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 289/575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:15 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:15.739113 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:15.739722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:15.746816 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:15.747305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:15.747748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:15.748475 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:15.748944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:15.749354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:15.883707 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:15.888043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:15.893515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c064451a-0969-4e00-a733-d9e0462265cc tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.158221 Aug 17 16:20:15.894083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 287/576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:15 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:16.132969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:16.133578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:16.140091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:16.140514 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:16.140945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:16.141657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:16.142110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:16.142532 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:16.274145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:16.281547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-63ae9cdf-6db7-48f4-8d5c-6d38d469a697 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.152492 Aug 17 16:20:16.282113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 290/577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:16 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:16.914594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:16.915231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:16.931682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:16.932357 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:16.933005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:16.933716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:16.934246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:16.934592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:17.077089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:17.085601 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-503dc323-5e84-4e98-bfdf-2e844b37fa79 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.174807 Aug 17 16:20:17.086188 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 288/578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:16 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:17.302459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:17.303089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:17.309535 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:17.310023 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:17.310454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:17.311150 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:17.311598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:17.312044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:17.492541 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:17.500188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2a3d8c34-63e9-4b4e-ae7d-7e7431ca8096 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.201548 Aug 17 16:20:17.500767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 291/579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:17 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:17.562399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e0083a-354a-4803-8836-df34ad67fc87", "tag": "6f9fe406-209c-400e-b27a-688797566203"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:17.571594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:17.572095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:17.573090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:17.583626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] Creating event network-changed:6f9fe406-209c-400e-b27a-688797566203 for instance 04e0083a-354a-4803-8836-df34ad67fc87 on hv-cinder-85220 Aug 17 16:20:17.589482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-abbdfb98-22b8-4c5d-97ed-9c3e5daced7e req-3cf22f18-e667-4068-958b-20d08c4a3dee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029973 Aug 17 16:20:17.590306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 289/580] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:18.110824 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:18.111587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:18.118047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:18.118560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:18.118993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:18.120375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:18.128552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:18.129012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:18.339257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:18.347163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2e6a1dba-5ea2-4ba3-a458-373dd58f34df tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1733 microversion: 2.1 time: 0.240205 Aug 17 16:20:18.348024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 292/581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:18 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1733 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:18.521682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:18.522379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:18.528536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:18.529012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:18.529443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:18.530124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:18.530583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:18.531003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:18.664756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:18.672932 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-adcee71a-5875-4d0e-b63d-fd4d2d140459 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.155988 Aug 17 16:20:18.673495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 290/582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:18 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:19.368125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:19.368727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:19.375670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.376173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.376600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.377275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.377721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.378132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.395721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:19.513288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:19.521199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0341800a-95a6-41e2-aed4-1e67c58e252c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1713 microversion: 2.1 time: 0.156866 Aug 17 16:20:19.521759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 293/583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:19 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:19.629213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:19.629722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:19.636032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.636513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.636949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.637634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.638087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.638508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.693774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:19.694382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:19.700371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.700849 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.701277 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.701965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.702416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.702838 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.764153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b while it is in vm_state rescued Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Request method failure captured: Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments/8807741a-753d-4f13-9751-818b59687059 HTTP/1.1 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQqHZKuaAiyqFjaNcW4VDU4SIhJamf9MhR-Y4YYnOc5FSet_KVS4jphoPy2GrHow9_JyfSVl9dw1VFA_2ge4UFA5oLrcBO5Ah_BJnSXxd8mm0Uuf_WZ4HHrc3ci8EEEPHKEqy-gVhGXDuwi8b4yKMPmqPKkHEXc4v759UwKAgWVFIk Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:20:19.765681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34b7fa307d994f2792503e6761f3c079", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 9fe81a429dee4fba8708445dcefa293e Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:20:19.766990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Cannot 'detach_volume' instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b while it is in vm_state rescued Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'server_id': '6d5f23e7-06ad-4a94-992b-8d5a76ad345b', 'id': '8807741a-753d-4f13-9751-818b59687059'} Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:19.767668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b while it is in vm_state rescued Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b while it is in vm_state rescued Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:19.769663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Returning 409 to user: Cannot 'detach_volume' instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b while it is in vm_state rescued {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:19.770837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9b049c35-d074-4ea4-bc1e-23fd9112b810 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments/8807741a-753d-4f13-9751-818b59687059" status: 409 len: 152 microversion: 2.1 time: 0.141818 Aug 17 16:20:19.770837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 291/584] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:20:19 2022] DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments/8807741a-753d-4f13-9751-818b59687059 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 16:20:19.776797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:19.777343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:19.787592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.788128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.788594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.789300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.790038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.790465 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.840404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:19.848168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b1cd020b-3663-417a-8bab-2c7ab0bca394 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.158103 Aug 17 16:20:19.848733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 294/585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:19 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:19.865876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c0a16a8b-9bff-4710-bd00-2d7b41edf338 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/action" status: 202 len: 0 microversion: 2.1 time: 0.093432 Aug 17 16:20:19.866490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 292/586] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:20:19 2022] POST /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:20:19.874755 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:19.875488 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:19.881341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.881818 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.882248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:19.882922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:19.883368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:19.883790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:20.014129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:20.022137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-63263964-0b11-4369-88cb-9894999638ce tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1721 microversion: 2.1 time: 0.151084 Aug 17 16:20:20.022670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 295/587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:19 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:20.872126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:20.872836 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:20.874812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:20.881470 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:20.881944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:20.882371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:20.883052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:20.883500 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:20.883937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:21.015449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:21.022917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-33eb7f1d-2322-46e5-872c-7872ccf2dba7 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.156215 Aug 17 16:20:21.023480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 293/588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:20 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:21.044668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:21.045415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:21.051982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:21.052466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:21.052965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:21.053654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:21.054105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:21.054556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:21.189370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:21.197344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ec55cbab-1579-41ed-be44-00c90c3725d2 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1721 microversion: 2.1 time: 0.157310 Aug 17 16:20:21.197916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 296/589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:21 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:22.044543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:22.045178 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:22.051610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:22.052115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:22.052544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:22.053223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:22.053670 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:22.054088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:22.181654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:22.189027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8ed6128a-ff86-4fd3-995d-7d5160f73b31 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.149224 Aug 17 16:20:22.189573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 294/590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:22 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:22.218937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:22.219546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:22.226218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:22.226693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:22.227122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:22.227823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:22.228279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:22.228857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:22.373969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:22.382468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-93edb328-36e9-4df3-9dd8-3bff4a1cb887 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1721 microversion: 2.1 time: 0.167069 Aug 17 16:20:22.383377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 297/591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:22 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:23.210839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:23.211982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:23.221364 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:23.221850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:23.222549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:23.223275 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:23.223752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:23.224195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:23.397823 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:23.405124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:23.405762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:23.406652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-37da3d8f-a8c4-484b-a8f3-c508dbe799a5 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.199875 Aug 17 16:20:23.407678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 295/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:23 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:23.408072 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:23.415516 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:23.416379 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:23.416940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:23.417673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:23.418244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:23.418528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:23.572971 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:23.581306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e13af2bc-6227-41f4-ac58-f9ea5e1a89d4 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1721 microversion: 2.1 time: 0.181001 Aug 17 16:20:23.581882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 298/593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:23 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:24.432574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:24.433105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:24.435110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:24.435976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:24.441539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e0083a-354a-4803-8836-df34ad67fc87", "name": "network-vif-plugged", "status": "completed", "tag": "6f9fe406-209c-400e-b27a-688797566203"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:24.442054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.442173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.442579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.443279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.443731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.444183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.451399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:24.458271 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.458881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.459315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.472723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] Creating event network-vif-plugged:6f9fe406-209c-400e-b27a-688797566203 for instance 04e0083a-354a-4803-8836-df34ad67fc87 on hv-cinder-85220 Aug 17 16:20:24.478494 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-6313f60d-5106-4a6a-9e3a-83a9463c7ce3 req-11140b05-bb32-418a-a13c-760aaab191ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041101 Aug 17 16:20:24.479437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 299/594] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:24.603643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:24.605012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:24.611615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:24.618442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.618950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.619491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.620621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.620928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.621038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c4a0c750-2b4e-4921-aefd-aedd9ba52604 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.192035 Aug 17 16:20:24.621345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.621985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 296/595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:24 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:24.812751 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:24.820745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-32c15f8a-329b-4220-a65d-b5e75782bf17 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1727 microversion: 2.1 time: 0.221593 Aug 17 16:20:24.821309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 300/596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:24 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:24.841587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:24.842081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:24.848309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.848789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.849216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.849897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:24.850349 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:24.850773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:24.927382 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f46282c5-a30c-499c-90c3-eb6f9f8a6f82 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089691 Aug 17 16:20:24.928028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 297/597] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:20:24 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:25.642046 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:25.642655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:25.649027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:25.649512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:25.649947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:25.651186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:25.651640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:25.652092 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:25.810291 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:25.829013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:25.831001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:25.832133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:25.846450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] Creating event network-changed:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:20:25.851732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-5aa140aa-711a-444a-8186-bc208f2d98fe req-49e1a27a-4f7c-4649-a7a3-b63d849d5958 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045564 Aug 17 16:20:25.852466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 298/598] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:25.985709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:25.993309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-35c8a464-0d8b-4922-b19e-03039f42dc3d tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1318 microversion: 2.1 time: 0.355196 Aug 17 16:20:25.994641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 301/599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:25 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:26.077292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:26.077974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:26.084415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.084911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.085350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.086046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.086504 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.086931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.117565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e9b481af-5e74-46cb-b71e-f99e0e1bab3e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments/144fec97-d1c3-4ad0-9034-5710f734020d" status: 200 len: 194 microversion: 2.20 time: 0.044420 Aug 17 16:20:26.118174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 299/600] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Aug 17 16:20:26 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments/144fec97-d1c3-4ad0-9034-5710f734020d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:20:26.186175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:26.186662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:26.192512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.192995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.193419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.194100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.194710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.195126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.278484 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lazy-loading 'services' on Instance uuid 25fb5ec0-85bf-4268-a9ab-3d0f89924363 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:26.352114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-766d9b12-1b80-4752-b0cb-1fceee5b3617 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments/144fec97-d1c3-4ad0-9034-5710f734020d" status: 202 len: 0 microversion: 2.20 time: 0.170457 Aug 17 16:20:26.352707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 302/601] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 17 16:20:26 2022] DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments/144fec97-d1c3-4ad0-9034-5710f734020d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:20:26.361047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:26.363500 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:26.370190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.370739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.371236 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.372127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:26.372676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:26.373138 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:26.405372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-51a43414-4add-4a12-b45d-6cf140774cba tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047973 Aug 17 16:20:26.405895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 300/602] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 17 16:20:26 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:20:27.016867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:27.017477 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:27.023653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.024162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.024586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.025446 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.026221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.026978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.162153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:27.170193 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f35e37d2-5f2b-4c50-ae02-02e8766bda3f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1506 microversion: 2.1 time: 0.158437 Aug 17 16:20:27.170782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 303/603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:27 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:27.190448 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bd44bfc-4e98-43c0-b97e-c6d16e09ba6b", "device": "/dev/sdb"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:27.193460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:27.200708 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.201293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.201787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.202477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.202957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.203378 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.417940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:27.420271 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:27.426374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.426856 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.427480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.428343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.428802 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.429228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.460211 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-853db8b3-2f82-43f5-9048-8a51c5f3e734 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046942 Aug 17 16:20:27.460874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 304/604] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 17 16:20:27 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:20:27.491165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-494233265"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:27.491441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:27.499206 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.500050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.500475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.501200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.501778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.502414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.553602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-40fd9cbc-7dd4-418d-ab74-a8b432dc1879 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "POST /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366868 Aug 17 16:20:27.554644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 301/605] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:20:27 2022] POST /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:27.875301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:27.893014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:27.893874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:27.894645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:27.914662 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] Creating event network-changed:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:20:27.922352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-69407c76-c4e6-47d3-bc3d-8257eb660dcf req-f60e4eb6-7613-41e6-9b40-41b9bd3e109e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056223 Aug 17 16:20:27.923389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 302/606] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:27.936644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.network.security_group_api [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Removing security group de3de8df-80e0-420d-b00c-4150ec15d32f from port bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 Aug 17 16:20:28.455570 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e80d661f-a132-466c-9d5f-8af7fb64bc81 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action" status: 202 len: 0 microversion: 2.1 time: 0.969285 Aug 17 16:20:28.456580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 305/607] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:20:27 2022] POST /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:20:28.467374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:28.481574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:28.483857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:28.486301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.486789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.487220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.501962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.502465 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.502906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.503622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.504133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.504560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.511455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] Creating event network-changed:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:20:28.522460 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-c7ba32fb-c941-4a44-b6fe-b6585ed2ff41 req-2d33e6eb-c211-4792-9dd8-d84353998ac5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060105 Aug 17 16:20:28.527156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 303/608] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:28.548415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7edff619-6d13-413a-a6ef-61ffaf9282c2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074922 Aug 17 16:20:28.549013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 306/609] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 17 16:20:28 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:28.657489 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:28.658393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:28.667144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.667982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.668639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.669545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.670222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.670863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.704181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:20:28.749395 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:28.817833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-062381be-ac8e-4e44-942a-851444bb1227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 204 len: 0 microversion: 2.20 time: 0.164335 Aug 17 16:20:28.819476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 304/610] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 17 16:20:28 2022] DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 16:20:28.829116 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:28.830262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:28.837267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.838304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.838962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.839936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:28.841784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:28.842288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:28.985917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:28.994678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:28.996499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:28.997782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7609b368-de34-4630-80a4-4f15411ca3c7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.173269 Aug 17 16:20:28.998412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 307/611] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:28 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:29.814266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:29.814861 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:29.821183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:29.821665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:29.822781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:29.823479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:29.823964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:29.824389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:29.942187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:29.957228 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:29.957990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:29.958635 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:29.974167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] Creating event network-changed:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:20:29.979414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-bb4ea697-2849-4306-a7d2-4a82e674b2b2 req-50870090-5a96-44c8-92bb-efdc04015e77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041440 Aug 17 16:20:29.980655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 308/612] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:30.016359 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lazy-loading 'services' on Instance uuid ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:30.022038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:30.022741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:30.029308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:30.029795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:30.030233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:30.030926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:30.031381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:30.031825 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:30.137929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e5e1b42a-452b-43bb-98c7-ca1e7c8c9428 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments/bfa12b9a-53dd-46fb-a336-762de029cf37" status: 202 len: 0 microversion: 2.1 time: 0.327758 Aug 17 16:20:30.142356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 305/613] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:20:29 2022] DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments/bfa12b9a-53dd-46fb-a336-762de029cf37 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:20:30.147780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:30.150412 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:30.157218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:30.157779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:30.158287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:30.159191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:30.159715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:30.160395 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:30.173739 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:30.183072 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:30.185154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:30.186579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f9b0d09f-a9bd-41fe-a83a-6b9ffa7c8e93 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.168670 Aug 17 16:20:30.191937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 309/614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:30 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:30.192191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-943b5947-8c32-4a09-a5f5-c36bacabc367 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047779 Aug 17 16:20:30.192191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 306/615] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:30 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:31.204538 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:31.207252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:31.210613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:31.211703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:31.214872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:31.215356 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:31.215788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:31.216496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:31.216942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:31.217355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:31.218992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:31.219469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:31.220109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:31.221959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:31.221959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:31.221959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:31.249557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ed9155a7-cc10-4f5c-b135-cd6eb2d959ef tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049114 Aug 17 16:20:31.250512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 310/616] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:31 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:31.377365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:31.385954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:31.387469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:31.388654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-db2c8caa-d18b-4fbf-8a2e-1d72c1727c0d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1722 microversion: 2.20 time: 0.182015 Aug 17 16:20:31.389210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 307/617] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:31 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:32.224109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fb5ec0-85bf-4268-a9ab-3d0f89924363", "name": "network-vif-deleted", "tag": "2fa756e6-365f-46f7-b4dc-acd68d33e3ca"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:32.236657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.237575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.238243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.244853 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:32.256502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] Creating event network-vif-deleted:2fa756e6-365f-46f7-b4dc-acd68d33e3ca for instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 on hv-cinder-85220 Aug 17 16:20:32.262176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:32.264433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-5d7f0cf3-46c3-4f2a-95b3-b37b085626ea req-1aa213b0-7640-4d10-92bd-b94b87ce2694 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043629 Aug 17 16:20:32.265703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:32.266408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 311/618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:32.274418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.275684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.276156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.276848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.277300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.277722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.311852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2b2feb88-ab04-4bda-a0f5-d642ada4536f tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053533 Aug 17 16:20:32.312452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 308/619] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:32 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:32.414031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:32.415917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:32.423945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.424833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.425419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.436121 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.436651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.437089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.476124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:32.476600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:32.477028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:32.477473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lazy-loading 'fault' on Instance uuid 25fb5ec0-85bf-4268-a9ab-3d0f89924363 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:32.522456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:32.531466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:32.532979 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:32.534119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-636e3306-49b7-447e-ab32-8fe12b415816 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 200 len: 1370 microversion: 2.20 time: 0.124744 Aug 17 16:20:32.539475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 312/620] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:32 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 1370 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:33.327308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:33.330468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:33.340300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:33.341007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:33.341674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:33.342538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:33.343139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:33.343764 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:33.387396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f197057a-cf0d-423c-9889-da1a9cb69624 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066811 Aug 17 16:20:33.388353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 309/621] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:33 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:33.556822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:33.557459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:33.563936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:33.564411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:33.564840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:33.565529 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:33.565977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:33.566393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:33.580406 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 HTTP/1.1 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:20:33.582070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:20:33.583637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '25fb5ec0-85bf-4268-a9ab-3d0f89924363'} Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:33.584584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:20:33.585954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:33.588034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:33.588034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ec98fc17-b18a-45d7-b68c-0898975ac693 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 404 len: 111 microversion: 2.20 time: 0.031306 Aug 17 16:20:33.588034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 313/622] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:33 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:20:33.597054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0749e4f7-9dce-4ff0-8846-ed6c9f70bd03 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '.version_select at 0x7f9eea43c790>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:33.619515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0749e4f7-9dce-4ff0-8846-ed6c9f70bd03 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611322155" status: 204 len: 0 microversion: 2.20 time: 0.026390 Aug 17 16:20:33.620297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 310/623] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Aug 17 16:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611322155 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 16:20:34.294542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-14835b98-4df1-47a9-afac-c6de80ce5393 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: .version_select at 0x7f9eea391550>, body: {"keypair": {"name": "tempest-keypair-1287924582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdE4m0oZYXfHZi3PDHHXoy70leQCaX9P4Vrsi4Mi0jpexemXhD97nUmVsUfl2JSrsXYlPHFasdYAwmHc6Fb0cidw2tpL6YneJXkYQ1b+31hDd31jBCEa61s0aJcMPt7hA=="}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:34.311247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-14835b98-4df1-47a9-afac-c6de80ce5393 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:20:34.319707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-14835b98-4df1-47a9-afac-c6de80ce5393 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for user 79729883ac964badae04665e547634da and project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:20:34.344511 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-14835b98-4df1-47a9-afac-c6de80ce5393 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054752 Aug 17 16:20:34.345110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 314/624] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 17 16:20:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 16:20:34.401279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:34.404040 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:34.415008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:34.416072 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:34.417043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:34.418018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:34.418272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:34.418692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:34.458498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-08f3ae4b-3ae3-4851-8320-dd009ed1ec5d tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061850 Aug 17 16:20:34.464991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 311/625] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:34 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:35.473168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:35.475479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:35.482507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:35.482985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:35.483415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:35.484140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:35.484676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:35.485004 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:35.515299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8f0f4e24-18b4-47ff-8d02-073209d4125a tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 17 16:20:35.516173 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 315/626] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:35 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:35.735830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-154631985", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f750ee49-8cce-4dda-9d0b-14dd03e56eff"}], "security_groups": [{"name": "tempest-securitygroup--254517072"}], "key_name": "tempest-keypair-1287924582", "user_data": "}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:35.836952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] validate_networks() for [('f750ee49-8cce-4dda-9d0b-14dd03e56eff', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:20:36.207303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:20:36.207722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:20:36.208225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:20:36.208638 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:20:36.209046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:20:36.218607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:36.219121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:36.219554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:36.220347 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:36.220800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:36.221224 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:36.238689 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:20:36.242651 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Getting quotas for user 79729883ac964badae04665e547634da and project d23a63f9104b44ff9afa19fc00dbbd37. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:20:36.253573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:20:36.255846 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:20:36.303469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7c843ecf-a7f7-437f-bb0e-cdea6e76fe59 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.571853 Aug 17 16:20:36.304131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 312/627] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 17 16:20:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 16:20:36.315575 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:36.316294 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:36.377103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:36.392641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:36.394151 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:36.395261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6da2d4ae-6ac7-48af-9b84-43546286f15f tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1281 microversion: 2.20 time: 0.084149 Aug 17 16:20:36.396186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 316/628] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:36 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:36.528779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:36.531012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:36.538128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:36.538602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:36.539026 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:36.539710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:36.540190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:36.540671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:36.569812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a550bbdf-2c17-4cad-a3a1-13dd9c85c208 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Aug 17 16:20:36.570719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 313/629] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:36 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:37.470556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:37.471166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:37.478167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:37.478643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:37.479075 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:37.479764 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:37.480244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:37.480663 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:37.539908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:37.547767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:37.549301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:37.550388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-78ac800a-1c0d-4c0a-9742-2dced4dd1f45 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1285 microversion: 2.20 time: 0.136663 Aug 17 16:20:37.550942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 317/630] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:37 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:37.582356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:37.584510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:37.590905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:37.591377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:37.591828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:37.592520 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:37.592970 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:37.593388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:37.621930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5f760f17-4676-4dcf-9059-9d72824a927b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 17 16:20:37.622474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 314/631] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:37 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:38.573394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:38.574095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:38.581828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:38.582313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:38.582774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:38.583471 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:38.583948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:38.584368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:38.633529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:38.635667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:38.642426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:38.642899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:38.643331 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:38.644062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:38.644517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:38.644940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:38.648354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:38.656673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:38.658222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:38.659327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ea48d6ad-8859-4d37-a553-f89bf5c49c95 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1277 microversion: 2.20 time: 0.089972 Aug 17 16:20:38.659906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 318/632] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:38 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:38.675260 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0e5b22ce-89fc-4e13-b8dc-cdfe54f1338e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Aug 17 16:20:38.675839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 315/633] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:38 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:39.683905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:39.684416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:39.687276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:39.689519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:39.691286 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.691941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.692382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.693131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.693921 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.694924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.696842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.697414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.697856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.698570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.699021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.699444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.729692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-21a6b446-c4f5-4664-8944-343d8f79cc8e tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046428 Aug 17 16:20:39.730266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 316/634] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:20:39 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 16:20:39.740293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:39.740788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:39.746774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.747253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.747684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.748396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:39.748854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:39.749276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:39.777522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:39.786044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:39.787612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:39.788734 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a0f79aa8-c24c-403e-acc2-18761794e469 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1339 microversion: 2.20 time: 0.110281 Aug 17 16:20:39.789499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 319/635] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:39 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:39.824809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] HTTP exception thrown: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 is not attached to volume bfa12b9a-53dd-46fb-a336-762de029cf37 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Request method failure captured: Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments/bfa12b9a-53dd-46fb-a336-762de029cf37 HTTP/1.1 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RR3R6XELertY6rxFoGGVy2yu9ePw9jjW419cSOhjHJuptn8aptzcqLwMXI9ywz5EW09H61HVF0-57u_W4XaYmutAr70_QbWNePcH_ohZC5RRRIyiMirSey26GE_qa1A5xwCz3IcOa-ed_n00OfiuwCyF4KLE4xQMs6o0WlIdFewCDA Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c73a224fc7784fd6876e81a0e7097127 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:20:39.836528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c73a224fc7784fd6876e81a0e7097127", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c73a224fc7784fd6876e81a0e7097127 Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-TestMinimumBasicScenario-531731753-project Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 388379cb8722477fbba3162dcbe3cc8a Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-TestMinimumBasicScenario-531731753-project Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:20:39.838602 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 is not attached to volume bfa12b9a-53dd-46fb-a336-762de029cf37 Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'server_id': 'ae041c2c-df6a-47dc-b33d-6a3c1cc107e3', 'id': 'bfa12b9a-53dd-46fb-a336-762de029cf37'} Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bfa12b9a-53dd-46fb-a336-762de029cf37. Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:39.839446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 is not attached to volume bfa12b9a-53dd-46fb-a336-762de029cf37 Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 is not attached to volume bfa12b9a-53dd-46fb-a336-762de029cf37 Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:39.841876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Returning 404 to user: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 is not attached to volume bfa12b9a-53dd-46fb-a336-762de029cf37 {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:39.843420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-487374e6-c3c9-45f4-98d2-eb216a7b47e6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments/bfa12b9a-53dd-46fb-a336-762de029cf37" status: 404 len: 154 microversion: 2.1 time: 0.102330 Aug 17 16:20:39.843420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 317/636] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:20:39 2022] DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3/os-volume_attachments/bfa12b9a-53dd-46fb-a336-762de029cf37 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:20:40.812494 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:40.813095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:40.820170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:40.820641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:40.821068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:40.822293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:40.822767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:40.823183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:40.955629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:40.964357 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:40.966191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:40.967301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2a66a88e-b466-43e0-b112-a36694150112 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.158774 Aug 17 16:20:40.967884 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 320/637] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:40 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:41.990187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:41.990683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:41.997576 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:41.998045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:41.998470 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:41.999147 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:41.999590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:42.000031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:42.128496 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:42.136522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:42.138031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:42.139121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-90e83376-187b-4465-a6cd-c62d5aba98f5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.152936 Aug 17 16:20:42.140265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 318/638] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:41 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:43.088933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:43.089452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:43.095746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.096258 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.096687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.097640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.098086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.098502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.135149 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:20:43.145687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:43.163067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.163873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.164516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.179209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] Creating event network-changed:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:20:43.189750 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-15b50d25-1366-4bb6-b8db-e5faa9e25656 req-838c0079-555f-4c7d-a12f-eb1c8119ca22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Aug 17 16:20:43.190931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 319/639] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:43.196183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:43.197718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:43.205206 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.205676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.206103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.206801 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.207251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.207675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.236777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-480d9f60-f41e-4c66-b750-4b7eb50b9c14 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 204 len: 0 microversion: 2.1 time: 0.152742 Aug 17 16:20:43.237943 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 321/640] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:20:43 2022] DELETE /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:20:43.247762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:43.249226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:43.255543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.256331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.256874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.257684 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:43.258244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:43.259942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:43.351192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:43.359629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:43.361163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:43.362256 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5c0df8cd-518c-406c-8efb-9f40aac9abb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.170255 Aug 17 16:20:43.363447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 320/641] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:43 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:43.392168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:43.400238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-02ed9f16-bafe-4300-8861-e5889ad23aa1 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1554 microversion: 2.1 time: 0.156474 Aug 17 16:20:43.400828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 322/642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:43 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:44.386063 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:44.386664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:44.393061 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:44.393559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:44.393983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:44.394659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:44.395105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:44.395520 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:44.422210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:44.422816 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:44.429437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:44.429980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:44.430495 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:44.431517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:44.432090 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:44.432531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:44.533286 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:44.536907 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:44.542443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:44.544011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:44.545118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c4a68626-21cd-4446-ba67-c07fbdc11ef0 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.163384 Aug 17 16:20:44.545676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 321/643] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:44 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:44.572143 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:44.580065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c4464543-f57f-411c-b67f-a1358bac83e0 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1554 microversion: 2.1 time: 0.161659 Aug 17 16:20:44.580677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 323/644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:44 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:45.567438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:45.568078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:45.575902 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:45.576383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:45.576821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:45.577531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:45.577986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:45.578404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:45.601975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:45.602581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:45.609504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:45.609987 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:45.610417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:45.611106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:45.611557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:45.612010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:45.713701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:45.722350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:45.723874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:45.724982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-81f5510e-f083-4d8f-b5b2-c08608543f77 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.161439 Aug 17 16:20:45.725543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 322/645] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:45 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:45.748905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:45.756294 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6b4c8d40-1e50-4b25-b883-90e461af8aa6 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1554 microversion: 2.1 time: 0.158170 Aug 17 16:20:45.756859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 324/646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:45 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:46.748355 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:46.748965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:46.750795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:46.751502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:46.758127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:46.758607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:46.759037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:46.759767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:46.760909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:46.761339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:46.777579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:46.778187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:46.780463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:46.786362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:46.787049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:46.787649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:46.789055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:46.789515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:46.789933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:46.899933 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:46.907958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:46.909473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:46.910583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1c62479a-4cdf-4145-a5e4-48faca300bb8 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.166797 Aug 17 16:20:46.911305 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 323/647] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:46 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:47.085120 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:47.085617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:47.091545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:47.092061 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:47.092490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:47.093176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:47.093630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:47.094046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:47.098307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:47.108082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-26c7b33a-ef2a-40aa-b468-c3b253d5e95b tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1554 microversion: 2.1 time: 0.334277 Aug 17 16:20:47.109054 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 325/648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:46 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1554 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:20:47.182518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lazy-loading 'services' on Instance uuid 04e0083a-354a-4803-8836-df34ad67fc87 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:47.255640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ab9eac99-6617-4f57-a1d0-93813db99b4f tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87/os-volume_attachments/7bd44bfc-4e98-43c0-b97e-c6d16e09ba6b" status: 202 len: 0 microversion: 2.1 time: 0.174335 Aug 17 16:20:47.257226 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 324/649] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:20:47 2022] DELETE /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87/os-volume_attachments/7bd44bfc-4e98-43c0-b97e-c6d16e09ba6b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:20:47.511315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae041c2c-df6a-47dc-b33d-6a3c1cc107e3", "name": "network-vif-deleted", "tag": "bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:47.520793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:47.521272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:47.521696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:47.532741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] Creating event network-vif-deleted:bdd8ffa4-bf10-4152-b5e3-6c8ed4acb925 for instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 on hv-cinder-85220 Aug 17 16:20:47.537448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-dbceadc2-78a9-4da0-a080-478d25936bc7 req-de4ff489-4084-4acc-950d-10a9f1dbf1a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030484 Aug 17 16:20:47.538038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 326/650] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:47.934722 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:47.935533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:47.942353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:47.942829 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:47.943261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:47.943987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:47.944437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:47.944855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.084978 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:48.093064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:48.094569 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:48.095661 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a1e5d406-7e9d-4c13-b8dc-e4a4e361cf0b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.165824 Aug 17 16:20:48.096249 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 325/651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:47 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:48.131374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:48.132091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:48.139461 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.139963 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.140389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.141060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.141503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.141917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.171567 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.172068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.172493 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.172931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lazy-loading 'fault' on Instance uuid ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:48.217399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388379cb8722477fbba3162dcbe3cc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73a224fc7784fd6876e81a0e7097127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:48.225094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8b3d4fe3-1a37-4d84-8dd8-9b0c652646ba tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 200 len: 1348 microversion: 2.1 time: 0.098312 Aug 17 16:20:48.225651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 327/652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:48 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:48.379574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:48.380429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:48.387150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.387985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.388311 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.389045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.389459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.390019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.417815 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:20:48.508109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-95e71c5e-2e0d-40e6-8b5f-a06c6d61ffbd tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 204 len: 0 microversion: 2.1 time: 0.131861 Aug 17 16:20:48.508837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 326/653] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:20:48 2022] DELETE /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:20:48.517820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:48.518539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:48.524783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.525330 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.526248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.527015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:48.527467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:48.527924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:48.906685 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:48.914205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a9f07bad-5000-4595-a38e-d60212345dfe tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1512 microversion: 2.1 time: 0.400316 Aug 17 16:20:48.914766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 328/654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:48 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:49.124201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:49.124911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:49.133051 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.133879 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.134317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:49.135054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.135507 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.136126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:49.247948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:49.248680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] [instance: ae041c2c-df6a-47dc-b33d-6a3c1cc107e3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:49.255405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.256099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.256543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:49.257257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.257806 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.258230 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:49.268265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:49.272821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] HTTP exception thrown: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Request method failure captured: Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 HTTP/1.1 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RR3R6XELertY6rxFoGGVy2yu9ePw9jjW419cSOhjHJuptn8aptzcqLwMXI9ywz5EW09H61HVF0-57u_W4XaYmutAr70_QbWNePcH_ohZC5RRRIyiMirSey26GE_qa1A5xwCz3IcOa-ed_n00OfiuwCyF4KLE4xQMs6o0WlIdFewCDA Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c73a224fc7784fd6876e81a0e7097127 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:20:49.274491 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c73a224fc7784fd6876e81a0e7097127", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c73a224fc7784fd6876e81a0e7097127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c73a224fc7784fd6876e81a0e7097127 Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-TestMinimumBasicScenario-531731753 Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-TestMinimumBasicScenario-531731753-project Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 388379cb8722477fbba3162dcbe3cc8a Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-TestMinimumBasicScenario-531731753-project Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. Aug 17 16:20:49.276080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'ae041c2c-df6a-47dc-b33d-6a3c1cc107e3'} Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:49.276980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. Aug 17 16:20:49.278260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:20:49.279378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Returning 404 to user: Instance ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:49.279378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-56e3e40a-9391-4523-9483-21f7c78b6207 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3" status: 404 len: 111 microversion: 2.1 time: 0.033558 Aug 17 16:20:49.279378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 329/655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:49 2022] GET /compute/v2.1/servers/ae041c2c-df6a-47dc-b33d-6a3c1cc107e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:20:49.282538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:49.284329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:49.285187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c48e815b-db80-49e5-aa43-e38801a9a523 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] Calling method '.version_select at 0x7f9eea344b80>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:49.285841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1bb60d84-4a89-4293-a2a3-97c29e5a159b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.171068 Aug 17 16:20:49.286711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 327/656] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:49 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:49.317515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c48e815b-db80-49e5-aa43-e38801a9a523 tempest-TestMinimumBasicScenario-531731753 tempest-TestMinimumBasicScenario-531731753-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-433260614" status: 202 len: 0 microversion: 2.1 time: 0.036055 Aug 17 16:20:49.318203 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 330/657] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Aug 17 16:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-433260614 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:20:49.934574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:49.935447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:49.937571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:49.943098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.943571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.944033 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:49.944718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:49.945164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:49.945581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:50.087846 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:50.096255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-522b3e09-45e8-41cf-bd75-3a6c1d61df43 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1512 microversion: 2.1 time: 0.165622 Aug 17 16:20:50.096832 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 328/658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:49 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:50.311109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:50.311677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:50.320235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:50.320724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:50.321164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:50.321866 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:50.322905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:50.323338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:50.327599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:50.678969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:50.688729 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:50.690226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:50.691323 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1a9579c4-c702-403c-9713-8ee4896558a5 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.385356 Aug 17 16:20:50.691891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 331/659] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:50 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:20:50.894045 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "name": "network-vif-plugged", "status": "completed", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:50.907187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:50.907681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:50.908153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:50.921701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] Creating event network-vif-plugged:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:20:50.927222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-1295ecd8-3998-4d74-9251-cdcb207e2e2d req-199a3949-dc90-4f13-b9ce-8820c14ec6dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037011 Aug 17 16:20:50.929213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 329/660] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:51.123736 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:51.127579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:51.137281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:51.137763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:51.138189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:51.139060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:51.139664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:51.140266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:51.449825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e0083a-354a-4803-8836-df34ad67fc87", "name": "network-vif-deleted", "tag": "6f9fe406-209c-400e-b27a-688797566203"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:51.459594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:51.460352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:51.460777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:51.471922 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] Creating event network-vif-deleted:6f9fe406-209c-400e-b27a-688797566203 for instance 04e0083a-354a-4803-8836-df34ad67fc87 on hv-cinder-85220 Aug 17 16:20:51.477704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-9a531f79-f160-44dc-97bf-968367a97f17 req-dd7abc89-fd41-4461-b832-a1dd2cfdba83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032081 Aug 17 16:20:51.479833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 330/661] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:20:51.539525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:51.548705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e80e51c9-59a7-4555-9ce0-8c5f9a24af65 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1512 microversion: 2.1 time: 0.433071 Aug 17 16:20:51.563109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 332/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:51 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:51.715006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:51.715687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:51.721863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:51.722587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:51.723011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:51.724035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:51.724486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:51.724901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:51.856894 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:51.864868 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:51.866350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:51.867430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-299c20ab-1e00-43e6-a285-efa5c4154d28 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1406 microversion: 2.20 time: 0.157510 Aug 17 16:20:51.868015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 331/663] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:51 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:20:52.570962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:52.571885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:52.579233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.579881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.580420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.581263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.581898 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.582401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.623970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.624463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.624892 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.625342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lazy-loading 'fault' on Instance uuid 04e0083a-354a-4803-8836-df34ad67fc87 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:20:52.686893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4524f04719f54a1eb79e4590a86f8f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28896a54086b475eacbbc8bd55e2edc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:52.694578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-706dce01-230a-4758-b02a-f8827ac852c1 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 200 len: 1308 microversion: 2.1 time: 0.127984 Aug 17 16:20:52.695161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 333/664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:52 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:20:52.890407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:52.891002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:52.897443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.897925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.898364 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.899044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.899495 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.900824 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.959697 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e0083a-354a-4803-8836-df34ad67fc87", "name": "network-vif-unplugged", "status": "completed", "tag": "6f9fe406-209c-400e-b27a-688797566203"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:52.970106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:52.970962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:52.971540 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:52.986264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] Creating event network-vif-unplugged:6f9fe406-209c-400e-b27a-688797566203 for instance 04e0083a-354a-4803-8836-df34ad67fc87 on hv-cinder-85220 Aug 17 16:20:52.992367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-f78c8f5f-e0e3-4367-864f-0aaf0278a54a req-f4f79b72-2366-4eaf-bf05-bc6c47240ab8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036618 Aug 17 16:20:52.993322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 334/665] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:20:53.047921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:53.056210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:53.058361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:20:53.059567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8bac24f4-98da-4340-82a4-7b10e87d10b2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1599 microversion: 2.20 time: 0.173338 Aug 17 16:20:53.060159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 332/666] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:20:52 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:20:53.089306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:53.090160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:53.093015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:53.099020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:53.099698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:53.100250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:53.100990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:53.101667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:53.102162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:53.219015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d135fe58-ad1e-437f-b39c-8f5fd807e66a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136943 Aug 17 16:20:53.219620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 335/667] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 17 16:20:53 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:20:53.716485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:20:53.717015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] [instance: 04e0083a-354a-4803-8836-df34ad67fc87] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:20:53.740393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:53.740881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:53.741312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:53.742010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:53.742527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:53.742941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:53.794147 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] HTTP exception thrown: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Request method failure captured: Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 HTTP/1.1 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RTZfaAKqcHxxvifvrdE44_Ou7F-p7NT3RWIv4K0obtbmkasJXTrrIlW1n6WGt3NcGyvWafddTwWdFIihytc6wN0dK2B-WUyWc-LPt7g3CPh0mWfDA7qT5c9zQyb-3ZRxQ3-liBz1nCwsvhzL-OLfWdOhXrSPyJTyrp_tv-FR49JLGU Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 28896a54086b475eacbbc8bd55e2edc1 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:20:53.796025 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_28896a54086b475eacbbc8bd55e2edc1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/28896a54086b475eacbbc8bd55e2edc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 28896a54086b475eacbbc8bd55e2edc1 Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-867474910 Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesSnapshotTestJSON-867474910-project Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 4524f04719f54a1eb79e4590a86f8f92 Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesSnapshotTestJSON-867474910-project Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. Aug 17 16:20:53.797319 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '04e0083a-354a-4803-8836-df34ad67fc87'} Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:20:53.798202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. Aug 17 16:20:53.799370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:20:53.801937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] Returning 404 to user: Instance 04e0083a-354a-4803-8836-df34ad67fc87 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:20:53.801937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e4f89431-60a0-47da-b4e1-9302af3b6621 tempest-VolumesSnapshotTestJSON-867474910 tempest-VolumesSnapshotTestJSON-867474910-project] 10.222.0.60 "GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87" status: 404 len: 111 microversion: 2.1 time: 0.085454 Aug 17 16:20:53.810152 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 333/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:20:53 2022] GET /compute/v2.1/servers/04e0083a-354a-4803-8836-df34ad67fc87 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:20:54.637126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:20:54.647185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:20:54.647657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:20:54.648115 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:20:54.661024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] Creating event network-changed:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:20:54.667864 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-88564d3e-4f78-4170-ac02-054ad0216838 req-7fbbfdd8-9976-42b3-8435-b4e65d63956b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101068 Aug 17 16:20:54.668636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 336/669] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:06.864330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:06.864856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:06.867486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=11 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:06.868971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:06.875798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:06.876369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:06.876998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:06.877723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:06.878196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:06.879004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:06.975998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lazy-loading 'services' on Instance uuid 6d5f23e7-06ad-4a94-992b-8d5a76ad345b {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:21:07.058639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-377aba04-b980-40d0-9e51-a8e4b91eaa4b tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments/8807741a-753d-4f13-9751-818b59687059" status: 202 len: 0 microversion: 2.1 time: 0.198473 Aug 17 16:21:07.059230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 334/670] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:21:06 2022] DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments/8807741a-753d-4f13-9751-818b59687059 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:21:07.065531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:07.066995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=26 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:07.072358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:07.080730 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:07.089497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:07.090035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:07.090487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:07.091183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:07.091628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:07.092072 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:07.126644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-14df26f7-5591-4492-8ff4-5d58ac6d3371 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062760 Aug 17 16:21:07.127268 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 337/671] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:21:07 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:21:08.144286 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:08.146620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:08.154145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.154631 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.155218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.155949 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.156394 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.156840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.186632 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f5b395f0-3c84-4747-bc89-f42e5b5b815c tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049198 Aug 17 16:21:08.187184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 335/672] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:21:08 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:21:08.263648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:08.264165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:08.271065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.271548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.272042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.272727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.273177 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.273665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.301599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:21:08.379229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9ead322b-cf34-47db-9372-b6dfaa0f6e19 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 204 len: 0 microversion: 2.1 time: 0.120536 Aug 17 16:21:08.379943 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 338/673] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:21:08 2022] DELETE /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:21:08.389707 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:08.390320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:08.396406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.396878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.397307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.397981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:08.398428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:08.398841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:08.530687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:08.538011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-34208b88-7e0b-40fa-b895-2f2405103a1e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1687 microversion: 2.1 time: 0.153949 Aug 17 16:21:08.538692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 336/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:08 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:09.560865 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:09.561492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:09.568407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:09.568917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:09.569344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:09.570036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:09.570480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:09.570894 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:09.716247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:09.723998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e06d2b5e-b45f-43d3-aea5-7d77f69b76c0 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1687 microversion: 2.1 time: 0.168205 Aug 17 16:21:09.724585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 339/675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:09 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:10.746576 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:10.747117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:10.753920 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:10.754401 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:10.754830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:10.755518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:10.756008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:10.756429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:10.894923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:10.902652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-06c0dcd7-9b20-4794-9cae-c3ea33c66d52 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1687 microversion: 2.1 time: 0.161153 Aug 17 16:21:10.903211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 337/676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:10 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:11.924355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:11.924968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:11.932083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:11.932572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:11.933000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:11.933747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:11.934202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:11.934627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:12.063820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:12.071297 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6b7955be-ce6f-4b77-beff-6402a7e7b706 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1687 microversion: 2.1 time: 0.150837 Aug 17 16:21:12.071880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 340/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:11 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:13.093030 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:13.094351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:13.102447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:13.103105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:13.104042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:13.104921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:13.105579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:13.106007 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:13.184134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:13.193178 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-eb6448f8-7257-4253-b240-8894582e6790 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 200 len: 1621 microversion: 2.1 time: 0.103901 Aug 17 16:21:13.194224 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 338/678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:13 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 1621 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:13.284982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5f23e7-06ad-4a94-992b-8d5a76ad345b", "name": "network-vif-deleted", "tag": "bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:13.296490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:13.297381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:13.298001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:13.311683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] Creating event network-vif-deleted:bc5c8fdc-b02b-4c63-b3b5-80623cc7fe72 for instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b on hv-cinder-85220 Aug 17 16:21:13.318024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-a7b0b59e-84b3-4646-be0a-777a4c8b2f1c req-b72a00f4-21c5-420b-8b6b-1a87e2042b9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175834 Aug 17 16:21:13.319527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 341/679] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:14.218462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:14.219621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 6d5f23e7-06ad-4a94-992b-8d5a76ad345b] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:14.231446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:14.232318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:14.233108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:14.234373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:14.235287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:14.235954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:14.261773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] HTTP exception thrown: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Request method failure captured: Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b HTTP/1.1 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQqHZKuaAiyqFjaNcW4VDU4SIhJamf9MhR-Y4YYnOc5FSet_KVS4jphoPy2GrHow9_JyfSVl9dw1VFA_2ge4UFA5oLrcBO5Ah_BJnSXxd8mm0Uuf_WZ4HHrc3ci8EEEPHKEqy-gVhGXDuwi8b4yKMPmqPKkHEXc4v759UwKAgWVFIk Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:21:14.265018 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34b7fa307d994f2792503e6761f3c079", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 9fe81a429dee4fba8708445dcefa293e Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. Aug 17 16:21:14.266444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '6d5f23e7-06ad-4a94-992b-8d5a76ad345b'} Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:21:14.267183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. Aug 17 16:21:14.268698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:21:14.269747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Returning 404 to user: Instance 6d5f23e7-06ad-4a94-992b-8d5a76ad345b could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:21:14.269747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f0d5e88e-3ef9-44f4-b690-832ae89e240f tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b" status: 404 len: 111 microversion: 2.1 time: 0.056084 Aug 17 16:21:14.269747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 339/680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:14 2022] GET /compute/v2.1/servers/6d5f23e7-06ad-4a94-992b-8d5a76ad345b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:21:14.282201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b9d8314a-6dfa-4bf2-9411-12d8391e5833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '.version_select at 0x7f9eea286f70>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:14.313018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b9d8314a-6dfa-4bf2-9411-12d8391e5833 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638558449" status: 202 len: 0 microversion: 2.1 time: 0.039263 Aug 17 16:21:14.316927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 342/681] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 17 16:21:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638558449 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:21:17.181459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:17.182228 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:17.188618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:17.189102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:17.189540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:17.190233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:17.190688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:17.191109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:17.216984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:21:17.301991 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d0b48a46-f9cb-495f-971d-98cb2815e911 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 204 len: 0 microversion: 2.1 time: 0.123960 Aug 17 16:21:17.303253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 340/682] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:21:17 2022] DELETE /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:21:17.312184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:17.312938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:17.320715 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:17.321311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:17.322394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:17.323320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:17.323980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:17.324416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:17.460900 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:17.468640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fd0ea91f-ffb1-4d54-94a8-3f477433c841 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1506 microversion: 2.1 time: 0.161347 Aug 17 16:21:17.469203 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 343/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:17 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:18.491778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:18.492427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:18.499473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:18.499989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:18.500424 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:18.501110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:18.501591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:18.502010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:18.634923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:18.642607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7fc67716-76d3-4ddc-aeb2-85d2614e58b1 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1506 microversion: 2.1 time: 0.156149 Aug 17 16:21:18.643167 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 341/684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:18 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:19.664233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:19.664881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:19.671974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:19.672459 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:19.672895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:19.673599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:19.674053 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:19.674501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:19.893474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:19.901216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-36759a16-d410-4a36-821c-575f8ca9163e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 200 len: 1506 microversion: 2.1 time: 0.240988 Aug 17 16:21:19.901793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 344/685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:19 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:20.200808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed26661-073f-4069-a175-c74cc4346cac", "name": "network-vif-deleted", "tag": "1493823e-675a-4f33-9189-631883a599da"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:20.212682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:20.213148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:20.213776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:20.226340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] Creating event network-vif-deleted:1493823e-675a-4f33-9189-631883a599da for instance 3ed26661-073f-4069-a175-c74cc4346cac on hv-cinder-85220 Aug 17 16:21:20.232302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-4af917f7-54c3-4e4f-b5b4-7c1085750729 req-bc554fa1-99a2-4072-9a70-7137c476ce39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036716 Aug 17 16:21:20.233588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 342/686] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:21:20.921788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:20.922394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 3ed26661-073f-4069-a175-c74cc4346cac] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:20.928741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:20.929246 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:20.929678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:20.930370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:20.930821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:20.931248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:20.944126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] HTTP exception thrown: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Request method failure captured: Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac HTTP/1.1 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQqHZKuaAiyqFjaNcW4VDU4SIhJamf9MhR-Y4YYnOc5FSet_KVS4jphoPy2GrHow9_JyfSVl9dw1VFA_2ge4UFA5oLrcBO5Ah_BJnSXxd8mm0Uuf_WZ4HHrc3ci8EEEPHKEqy-gVhGXDuwi8b4yKMPmqPKkHEXc4v759UwKAgWVFIk Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:21:20.945723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34b7fa307d994f2792503e6761f3c079", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 9fe81a429dee4fba8708445dcefa293e Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. Aug 17 16:21:20.947797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '3ed26661-073f-4069-a175-c74cc4346cac'} Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:21:20.949636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. Aug 17 16:21:20.951068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:20.952426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Returning 404 to user: Instance 3ed26661-073f-4069-a175-c74cc4346cac could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:21:20.952426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b41777fe-82d9-4dc9-abb5-de989b1b8d6a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac" status: 404 len: 111 microversion: 2.1 time: 0.029655 Aug 17 16:21:20.952426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 345/687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:20 2022] GET /compute/v2.1/servers/3ed26661-073f-4069-a175-c74cc4346cac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:21:20.956929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:20.957519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:20.964534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:20.965020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:20.965456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:20.966144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:20.966599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:20.967024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:20.991440 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:21:21.063644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a769c47f-fd85-459b-a38e-8e3ebfb06576 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "DELETE /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 204 len: 0 microversion: 2.1 time: 0.110732 Aug 17 16:21:21.064254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 343/688] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:21:20 2022] DELETE /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:21:21.073158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:21.073766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:21.079703 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:21.080225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:21.080659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:21.081342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:21.081791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:21.082213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:21.216840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:21.225950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-84535164-8cee-4d5e-8217-000c4708a68a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.157341 Aug 17 16:21:21.226516 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 346/689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:21 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:22.248733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:22.249424 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:22.255816 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:22.256306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:22.256739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:22.257421 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:22.257869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:22.258286 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:22.389626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:22.397173 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8ae41853-8ee5-47e7-9486-d05c043af60e tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.152629 Aug 17 16:21:22.397740 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 344/690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:22 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:23.419966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:23.420821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:23.427547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:23.428135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:23.428572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:23.429275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:23.429730 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:23.430157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:23.584022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:23.594356 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-abaf0a71-330e-4b3f-bdd7-a94aaaaac1fb tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1522 microversion: 2.1 time: 0.179559 Aug 17 16:21:23.594924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 347/691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:23 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:24.622521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:24.623136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:24.629532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:24.630017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:24.630686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:24.631733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:24.632393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:24.633042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:24.677149 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153d19a6-a000-4320-8e36-d1528026298f", "name": "network-vif-deleted", "tag": "1b394726-e1b8-49fa-afe3-9e3fad19f1ae"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:24.689931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:24.690444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:24.690872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:24.702408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] Creating event network-vif-deleted:1b394726-e1b8-49fa-afe3-9e3fad19f1ae for instance 153d19a6-a000-4320-8e36-d1528026298f on hv-cinder-85220 Aug 17 16:21:24.703931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe81a429dee4fba8708445dcefa293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b7fa307d994f2792503e6761f3c079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:24.707331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-955b6bb6-7be9-46cd-8fcf-530b625877d5 req-b3b7f74a-ee78-401f-acc5-fce7a0bf1b42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Aug 17 16:21:24.708012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 348/692] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:24.714663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-47cbf8b2-9810-4180-acce-2aa7b8b2255a tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 200 len: 1480 microversion: 2.1 time: 0.098634 Aug 17 16:21:24.715243 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 345/693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:24 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 1480 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:25.737731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:25.738432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] [instance: 153d19a6-a000-4320-8e36-d1528026298f] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:25.744669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:25.745144 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:25.745578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:25.746261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:25.746714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:25.747134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:25.760662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] HTTP exception thrown: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Request method failure captured: Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f HTTP/1.1 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQqHZKuaAiyqFjaNcW4VDU4SIhJamf9MhR-Y4YYnOc5FSet_KVS4jphoPy2GrHow9_JyfSVl9dw1VFA_2ge4UFA5oLrcBO5Ah_BJnSXxd8mm0Uuf_WZ4HHrc3ci8EEEPHKEqy-gVhGXDuwi8b4yKMPmqPKkHEXc4v759UwKAgWVFIk Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:21:25.762226 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34b7fa307d994f2792503e6761f3c079", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34b7fa307d994f2792503e6761f3c079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 34b7fa307d994f2792503e6761f3c079 Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1148384325 Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 9fe81a429dee4fba8708445dcefa293e Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1148384325-project Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. Aug 17 16:21:25.763670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '153d19a6-a000-4320-8e36-d1528026298f'} Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:21:25.764487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. Aug 17 16:21:25.765983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:25.767375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] Returning 404 to user: Instance 153d19a6-a000-4320-8e36-d1528026298f could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:21:25.767375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-df678263-89e0-4517-afe9-379af6eab430 tempest-ServerRescueNegativeTestJSON-1148384325 tempest-ServerRescueNegativeTestJSON-1148384325-project] 10.222.0.60 "GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f" status: 404 len: 111 microversion: 2.1 time: 0.030565 Aug 17 16:21:25.767375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 349/694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:25 2022] GET /compute/v2.1/servers/153d19a6-a000-4320-8e36-d1528026298f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:21:34.469225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0971de4a-4f52-4a52-8137-68b1b82eb8db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: .version_select at 0x7f9eea2f91f0>, body: {"keypair": {"name": "tempest-keypair-373785002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdiMAcSjYthftfUjNO8u0LyX+xrOM0uE72t/5C9wnJXGOjCF4h40pc9xtoXQ+VrcJBVhHp9gPM2cIvAvgYusZmaaEiiC3k6W8Z9ARE+LhtsPVMSLyShMXnn3e5f/YAb3A=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:34.487439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0971de4a-4f52-4a52-8137-68b1b82eb8db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for project 70e2e41d5730457a93725abb31d0a672. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:21:34.491775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0971de4a-4f52-4a52-8137-68b1b82eb8db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for user b7f7896e070541c18b391ff71320bc9a and project 70e2e41d5730457a93725abb31d0a672. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:21:34.516616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0971de4a-4f52-4a52-8137-68b1b82eb8db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200238 Aug 17 16:21:34.517325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 346/695] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:21:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:21:36.115827 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1636041261", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a9e1593-5ee1-4d66-98aa-a12dbf9a84d5"}], "security_groups": [{"name": "tempest-securitygroup--1973858214"}], "key_name": "tempest-keypair-373785002", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:36.124286 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:36.124948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:36.225597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] validate_networks() for [('4a9e1593-5ee1-4d66-98aa-a12dbf9a84d5', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:21:36.702962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:21:36.703385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:21:36.703966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:21:36.704549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:21:36.704961 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:21:36.715092 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:36.715572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:36.716039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:36.716771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:36.717221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:36.717639 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:36.735388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for project 70e2e41d5730457a93725abb31d0a672. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:21:36.739349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for user b7f7896e070541c18b391ff71320bc9a and project 70e2e41d5730457a93725abb31d0a672. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:21:36.751259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:21:36.753757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:21:36.801637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5f48d8c8-29ad-4705-bc33-23cef99cd6d0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690184 Aug 17 16:21:36.803941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 350/696] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:21:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:21:36.813394 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-da6ff099-9844-4c0a-a43b-c12fadaf2933 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:36.814005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-da6ff099-9844-4c0a-a43b-c12fadaf2933 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:36.815964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:36.874300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-da6ff099-9844-4c0a-a43b-c12fadaf2933 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:36.884806 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-da6ff099-9844-4c0a-a43b-c12fadaf2933 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1237 microversion: 2.1 time: 0.075012 Aug 17 16:21:36.885476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 347/697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:36 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:37.907523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:37.908696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:37.916035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:37.916581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:37.922256 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:37.923304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:37.923786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:37.924288 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:37.992259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:38.001269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ae0dc4d3-5b07-4651-8379-967e97d95484 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1289 microversion: 2.1 time: 0.099443 Aug 17 16:21:38.002100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 351/698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:37 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:39.022518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:39.024820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:39.026824 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:39.033057 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:39.033542 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:39.033976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:39.034673 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:39.035153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:39.035574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:39.107185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:39.107907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:39.121802 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:39.123767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:39.124489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:39.125485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:39.126221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:39.126603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:39.152522 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3969ea8b-4242-42f3-a355-a9e301c72064 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/ips" status: 200 len: 152 microversion: 2.20 time: 0.057831 Aug 17 16:21:39.153342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 352/699] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 17 16:21:39 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/ips => generated 152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 16:21:39.200195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:39.207597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a02ecfd2-7be5-4794-8838-9c13f1820cf3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.188951 Aug 17 16:21:39.208194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 348/700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:39 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:39.578560 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c735bc06-0c92-4467-a715-bd5d0ea33927", "tag": "eefc60df-73fc-4598-924f-cb507c23d5ce"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:39.589210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:39.589808 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:39.590358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:39.602130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] Creating event network-changed:eefc60df-73fc-4598-924f-cb507c23d5ce for instance c735bc06-0c92-4467-a715-bd5d0ea33927 on hv-cinder-85220 Aug 17 16:21:39.607186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-8ea44e01-0d59-4eef-aeb0-bac99802eade req-63f3bb7b-6b9a-4114-a6f3-a701aafa0cd0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032608 Aug 17 16:21:39.607891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 353/701] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:40.229767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:40.230379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:40.236820 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:40.237300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:40.237737 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:40.238432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:40.238887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:40.239306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:40.371378 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:40.378856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-13d4d099-8a49-4198-9e73-8b3e0650d597 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.153840 Aug 17 16:21:40.379423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 349/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:40 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:40.978903 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:40.979533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:40.986028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:40.986548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:40.987021 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:40.987721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:40.988211 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:40.988634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:41.012392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lazy-loading 'flavor' on Instance uuid d80dafe6-bdad-47e7-aaea-7bac9af16b69 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:21:41.191423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-64f457f8-ad72-43c0-afc1-4aa070b18f0e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/action" status: 202 len: 0 microversion: 2.20 time: 0.217359 Aug 17 16:21:41.192058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 354/703] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 17 16:21:40 2022] POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:21:41.200807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:41.201746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:41.207790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:41.208504 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:41.209100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:41.209971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:41.210438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:41.210895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:41.344047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:41.352257 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:41.354011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:41.355142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b1161273-756c-4521-837e-bd5a7cbb6b31 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.158270 Aug 17 16:21:41.355693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 350/704] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:41 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:41.401420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:41.402120 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:41.408611 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:41.409250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:41.409688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:41.410412 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:41.410891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:41.411331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:41.591906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:41.599702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8b9f515a-7dd4-46f6-9ce2-126644a9d030 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.203124 Aug 17 16:21:41.600218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 355/705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:41 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:42.202520 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:42.203102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:42.209309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.209795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.210227 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.210919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.211371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.211816 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.237198 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:21:42.310404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-75712ec5-1ba7-49d9-b27e-b0d0bd63cc61 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 204 len: 0 microversion: 2.1 time: 0.111477 Aug 17 16:21:42.311011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 351/706] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:21:42 2022] DELETE /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:21:42.320066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:42.323427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:42.331076 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.331593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.332058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.332752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.333208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.333629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.379320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:42.380039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:42.386774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.387265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.387687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.388411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.388863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.389283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.475117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:42.483793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4df6199d-765e-4390-99fb-d9abedad7836 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1577 microversion: 2.1 time: 0.168305 Aug 17 16:21:42.484596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 356/707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:42 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:42.527461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:42.536205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:42.537924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:42.538995 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6972d1ab-ea40-4e7f-91bd-f7707a108430 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.163878 Aug 17 16:21:42.539562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 352/708] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:42 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:21:42.622952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:42.623625 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:42.629438 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.629912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.630338 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.631015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:42.631458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:42.631896 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:42.765073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:42.772700 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b038d14c-3b24-4f60-9a23-2f5b3fb19512 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.155262 Aug 17 16:21:42.773275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 357/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:42 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:43.505289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:43.505942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:43.513003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.513483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.513909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.514599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.515049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.515468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.561606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:43.562217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:43.568665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.569142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.569574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.570262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.570710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.571130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.652244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:43.659969 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e7eecadc-4b12-44fe-9c84-dbef354ccebe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1577 microversion: 2.1 time: 0.158520 Aug 17 16:21:43.665140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 353/710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:43 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:43.706089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:43.714507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:43.716155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:43.717303 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-672cbbf7-3a53-4bd8-9126-95041bf648a2 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.159677 Aug 17 16:21:43.717861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 358/711] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:43 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:21:43.794014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:43.794619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:43.800701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.801184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.801616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.802300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:43.802752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:43.803199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:43.935856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:43.943261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-02fe557a-8687-4afc-9e5f-ba7c17525598 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.153776 Aug 17 16:21:43.943849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 354/712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:43 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:44.683202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:44.684057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:44.690964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.691471 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.692054 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:44.692750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.693200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.693619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:44.740947 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:44.741550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:44.748656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.749146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.749579 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:44.750280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.750733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.751195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:44.890366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:44.893194 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:44.900746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:44.902444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:44.903614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2e784cf2-6dc1-4f85-975c-db9d9fe317fb tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.166617 Aug 17 16:21:44.904485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 355/713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:44 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:21:44.916389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b3f9148e-3e9a-47cf-98da-4caa22f26248 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1577 microversion: 2.1 time: 0.236603 Aug 17 16:21:44.929552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 359/714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:44 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:44.964929 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:44.965500 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:44.972730 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.973436 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.973877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:44.974583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:44.975041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:44.975467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.119744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:45.129903 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b97972fb-ab6f-46b8-b2cb-b7ee5cfe4c9c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.167826 Aug 17 16:21:45.130980 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 356/715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:44 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:45.175005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c735bc06-0c92-4467-a715-bd5d0ea33927", "name": "network-vif-plugged", "status": "completed", "tag": "eefc60df-73fc-4598-924f-cb507c23d5ce"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:45.189436 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.189724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.190066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.202742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] Creating event network-vif-plugged:eefc60df-73fc-4598-924f-cb507c23d5ce for instance c735bc06-0c92-4467-a715-bd5d0ea33927 on hv-cinder-85220 Aug 17 16:21:45.208046 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-88f0cd6d-56e8-4a87-a5c6-26b9b391cb62 req-d3c1c29e-e2d2-40a8-abfa-4944ab71514e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109699 Aug 17 16:21:45.209005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 360/716] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:21:45.243322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7b5e26-05a5-4931-9022-7bf936165fef", "name": "network-vif-deleted", "tag": "20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:45.254015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.254784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.254910 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.269546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] Creating event network-vif-deleted:20cfe30f-a9f5-4fa7-b9cd-c2bf9c2edf30 for instance 6f7b5e26-05a5-4931-9022-7bf936165fef on hv-cinder-85220 Aug 17 16:21:45.275873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-c43cec2c-ba97-4cc2-bd53-36db757320e4 req-3f90d5db-cb28-47f2-9353-e46d56e3dc6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036067 Aug 17 16:21:45.276797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 357/717] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:21:45.928208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:45.929124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:45.936603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.937089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.937520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.938207 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.938817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.939406 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.940105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:45.940812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:45.947687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.948308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.948783 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.949729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.950195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.950625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.983873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:45.984396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:45.984831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:45.985283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lazy-loading 'fault' on Instance uuid 6f7b5e26-05a5-4931-9022-7bf936165fef {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:21:46.034989 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:46.042896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0ab8658e-9275-4583-aa8d-ed7ee397745b tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1230 microversion: 2.1 time: 0.107209 Aug 17 16:21:46.043653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 358/718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:45 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:46.088546 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:46.097508 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:46.099033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:46.100394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-14ea7c0d-3982-4ac6-8cb4-0ccc51598fe3 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.177021 Aug 17 16:21:46.100940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 361/719] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:45 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:46.151639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:46.152545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:46.158988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:46.159471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:46.159931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:46.160636 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:46.161087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:46.161506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:46.299166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:46.307214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a7993394-8ecc-4721-ac68-4c0bc754cb53 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1363 microversion: 2.1 time: 0.159351 Aug 17 16:21:46.307819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 359/720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:46 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:47.064996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:47.065543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:47.067449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:47.068129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:47.076307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.076801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.077239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.077938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.078415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.078837 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.111264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.111743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.112224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.112667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lazy-loading 'fault' on Instance uuid 6f7b5e26-05a5-4931-9022-7bf936165fef {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:21:47.124840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:47.125485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:47.127432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:47.133521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.134012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.134452 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.135156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.135612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.136067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.153452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:47.161017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f50d2311-a817-4956-b007-e2a19c6d2d55 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 200 len: 1230 microversion: 2.1 time: 0.099999 Aug 17 16:21:47.161616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 362/721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:47 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:47.268593 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:47.279169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:47.280693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:47.282371 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4b3482f9-4e74-4c7c-84b5-e9ef849e5d1e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.162345 Aug 17 16:21:47.285990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 360/722] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:47 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:21:47.329556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:47.330486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:47.337243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.337721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.338150 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.338869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.339335 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.339727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.473124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:47.480572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-93dd2efa-495c-4848-bc40-eb6d85247014 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1549 microversion: 2.1 time: 0.155616 Aug 17 16:21:47.481161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 363/723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:47 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:47.501295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:47.501790 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:47.507617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.508136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.508571 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.509258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:47.509710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:47.510128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:47.590043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-22aaabf5-84e4-42d5-9d9f-fed89d1c3f11 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092487 Aug 17 16:21:47.590637 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 361/724] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:21:47 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:48.182753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:48.184467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:48.191776 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:48.192291 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:48.192719 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:48.193406 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:48.193854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:48.194391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:48.208010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] HTTP exception thrown: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Request method failure captured: Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef HTTP/1.1 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RTJ-G5S80RH1NV1ENS1BcpyMl1Cd9kdarMBO_f20JfzJLStQvCddizgn3joQ1OSKQ6mADbjQYHqI4uLrj_TkKSW3YQ6a5wIaE-MR-val5NjvRBLnvBgYPAIYJYLgQ8WrBjadOSUkaK-_60FxqT0lZBCD7oxoW35x_1MfDFm81OwZU8 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:21:48.209657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c9eb10c3ae444a9c8472e9961a4ca79e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-TestVolumeBootPattern-826525536 Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 2f7f4cf57e814aebab32a56b19aa067f Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:21:48.211254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '6f7b5e26-05a5-4931-9022-7bf936165fef'} Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:21:48.212127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:21:48.213397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:21:48.215079 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Returning 404 to user: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:21:48.215079 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cf04f71f-fe6b-44af-8782-4c9f2edf8483 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 404 len: 111 microversion: 2.1 time: 0.032240 Aug 17 16:21:48.215079 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 364/725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:48 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:21:48.305956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:48.306570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:48.314250 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:48.314720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:48.315145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:48.315420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1304557841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-965676027", "security_groups": [{"name": "tempest-secgroup-smoke-503595786"}], "block_device_mapping_v2": [{"uuid": "4abcde86-c526-4080-ab23-b2e78ede5ebb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6a03044-b6d5-4e67-9b08-ead35b439913"}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:48.315862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:48.316313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:48.316730 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:48.437796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] validate_networks() for [('f6a03044-b6d5-4e67-9b08-ead35b439913', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:21:48.535124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:48.544447 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:48.545962 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:48.547127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-51f43eae-d029-4ea0-9e7a-d93e1b080086 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.245160 Aug 17 16:21:48.555760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 362/726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:48 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:48.606773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c735bc06-0c92-4467-a715-bd5d0ea33927", "tag": "eefc60df-73fc-4598-924f-cb507c23d5ce"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:48.616100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:48.616580 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:48.617009 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:48.630373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] Creating event network-changed:eefc60df-73fc-4598-924f-cb507c23d5ce for instance c735bc06-0c92-4467-a715-bd5d0ea33927 on hv-cinder-85220 Aug 17 16:21:48.635341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-fddec0c2-472b-48cf-a02f-84debdac28c2 req-b109e6fb-05ca-4238-8314-e3b23867d262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032493 Aug 17 16:21:48.639472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 363/727] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:49.187391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:21:49.187929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:21:49.188315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:21:49.188723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:21:49.189132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:21:49.202354 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:49.202953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:49.203480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:49.204725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:49.205272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:49.205940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:49.223531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:21:49.229098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for user 2f7f4cf57e814aebab32a56b19aa067f and project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:21:49.299132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:21:49.301250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4abcde86-c526-4080-ab23-b2e78ede5ebb',volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:21:49.441706 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d008ad2f-3877-4b70-a05c-68866051da15 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.130424 Aug 17 16:21:49.442247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 365/728] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:21:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 16:21:49.455252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c8672b08-0354-48dd-8830-721f290c4c8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:49.456054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c8672b08-0354-48dd-8830-721f290c4c8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:49.530216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c8672b08-0354-48dd-8830-721f290c4c8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:49.536995 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c8672b08-0354-48dd-8830-721f290c4c8e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1094 microversion: 2.1 time: 0.086697 Aug 17 16:21:49.538168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 364/729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:49 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:49.571397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:49.572269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:49.579854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:49.580659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:49.581168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:49.581937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:49.582595 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:49.583432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:49.741918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:49.750671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:49.752269 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:49.753426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-82c4dc1d-f240-4039-a915-7b8c90a545e4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.186369 Aug 17 16:21:49.753974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 366/730] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:49 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:50.558161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:50.559002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:50.566210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:50.566690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:50.567124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:50.567834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:50.568315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:50.568733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:50.573356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:50.636014 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:50.643915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1beee0f1-a0d7-4640-9fd0-1a1b21168e03 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1210 microversion: 2.1 time: 0.089524 Aug 17 16:21:50.644490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 365/731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:50 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:50.779168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:50.779951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:50.786552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:50.787114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:50.787621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:50.788468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:50.788928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:50.789464 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:50.990434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:50.994039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:51.000826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:51.002259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:51.003571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f0d0747e-d41f-491c-b4eb-d50f17a5df20 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.229039 Aug 17 16:21:51.004169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 367/732] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:50 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:51.665928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:51.666664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:51.673418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:51.673919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:51.674332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:51.675038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:51.675488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:51.675935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:51.810805 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:51.818485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8be3e9b7-7bb7-4f76-b78b-5cf4d104b759 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.156434 Aug 17 16:21:51.819060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 366/733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:51 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:52.027539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:52.028320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:52.035993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:52.036474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:52.036907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:52.037606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:52.038057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:52.038600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:52.077518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451c11ba-c2a2-49aa-8535-3ba1d2fa55f5", "tag": "d1692859-377d-4bc7-aad0-fe9cba24a28d"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:21:52.088094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:52.088712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:52.089867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:52.106439 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] Creating event network-changed:d1692859-377d-4bc7-aad0-fe9cba24a28d for instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 on hv-cinder-85220 Aug 17 16:21:52.111391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-b5370599-1472-41c7-9a7e-6563f909c27c req-6b325b60-07fc-4f7e-87e1-14a862c453cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Aug 17 16:21:52.112011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 367/734] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:21:52.244580 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:52.253295 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:52.254793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:52.255977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-2c8721c5-0891-42c6-8db1-06f4c60a5227 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.233658 Aug 17 16:21:52.271442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 368/735] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:52 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:52.841566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:52.842259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:52.849198 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:52.849709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:52.850221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:52.850950 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:52.851406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:52.851847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:52.991757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:53.002335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8d26d1b7-6bf1-40e6-b6ff-c7626975dca1 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.165630 Aug 17 16:21:53.002915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 368/736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:52 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:53.279619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:53.280298 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:53.286848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:53.287326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:53.287822 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:53.288763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:53.289245 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:53.289812 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:53.447387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:53.457426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:53.458991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:53.460468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e4672813-c00e-4ac5-914e-8e7103d16d07 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.185813 Aug 17 16:21:53.461022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 369/737] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:53 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:54.023048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:54.023645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:54.030148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:54.030630 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:54.031055 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:54.031733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:54.032204 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:54.032618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:54.161047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:54.169114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e82f8460-693d-4a2c-bb93-c782c4c59fd4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.149925 Aug 17 16:21:54.169681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 369/738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:54 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:54.485122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:54.485667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:54.492095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:54.492573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:54.493022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:54.493686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:54.494136 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:54.494552 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:54.626885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:54.634777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:54.636841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:54.637971 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ed65800b-1a25-4a67-b4e8-d0258da0c17a tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.156856 Aug 17 16:21:54.638539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 370/739] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:54 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:55.189530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:55.190138 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:55.196692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:55.197176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:55.197612 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:55.198306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:55.198957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:55.199383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:55.331822 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:55.339812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-dbfd2e14-570b-42b3-af7d-b4c6443475f4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.153455 Aug 17 16:21:55.340682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 370/740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:55 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:55.661258 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:55.661888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:55.668539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:55.669016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:55.669448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:55.670132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:55.670584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:55.671007 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:55.806010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:55.814650 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:55.816218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:55.817403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-353b1d89-f612-41e9-98cc-3967ca4768ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.160041 Aug 17 16:21:55.818071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 371/741] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:55 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:56.361137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:56.361743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:56.368184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:56.368663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:56.369102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:56.369789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:56.370299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:56.370852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:56.502586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:56.510276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d8d4f46b-6c91-4cb1-8d7c-36d3602428f2 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.152902 Aug 17 16:21:56.510776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 371/742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:56 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:56.841831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:56.842444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:56.849161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:56.849640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:56.850073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:56.850758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:56.851210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:56.851629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:56.982222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:56.990125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:56.991622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:56.992807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b1a49bd1-5e88-4976-b40b-4a6177eaa47c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1744 microversion: 2.20 time: 0.155781 Aug 17 16:21:56.993355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 372/743] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:56 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:57.531678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:57.532316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:57.538789 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:57.539268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:57.539697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:57.540407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:57.540863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:57.541284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:57.673680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:57.681121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6590dbde-3cde-47df-bb99-285d49e55285 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.153297 Aug 17 16:21:57.681686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 372/744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:57 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:21:58.015300 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:58.015937 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:58.022404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:58.022895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:58.023310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:58.024023 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:58.024475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:58.024893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:58.157342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:58.165138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:58.166624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:58.168759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-08277eec-77f5-4c7a-89f6-1d931b8bf569 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1744 microversion: 2.20 time: 0.157385 Aug 17 16:21:58.169317 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 373/745] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:58 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:58.702926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:58.703538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:58.710037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:58.710522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:58.710956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:58.711651 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:58.712148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:58.712568 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:58.845017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:58.852758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-537841eb-006a-4d7e-b947-fee1311a2703 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.154179 Aug 17 16:21:58.853314 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 373/746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:58 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:21:59.191542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:59.192243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:59.198756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:59.199222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:59.199646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:59.200355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:59.200798 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:59.201211 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:59.216488 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:59.241061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:59.345086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:59.353440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:59.355645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:21:59.356895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-42dd193c-41bd-4d68-beb1-a68ccde591bd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1744 microversion: 2.20 time: 0.169192 Aug 17 16:21:59.357456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 374/747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:21:59 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:21:59.874796 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:21:59.875407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:21:59.877408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:59.887052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:59.887543 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:59.888027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:21:59.890375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:21:59.890842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:21:59.891408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:00.040640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:00.050693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d7e84d3f-e477-483c-ace0-21fb3db48096 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.180442 Aug 17 16:22:00.051773 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 374/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:21:59 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:00.378873 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:00.379489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:00.387544 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:00.388264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:00.388801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:00.389523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:00.390302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:00.390881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:00.543027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:00.553819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:00.555607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:00.556993 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-700a6ff8-0088-4a2a-9314-eb5d89d33937 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.182428 Aug 17 16:22:00.557795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 375/749] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:00 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:01.075898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:01.077442 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:01.093906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:01.094412 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:01.095145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:01.096478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:01.097568 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:01.098269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:01.157008 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "name": "network-vif-plugged", "status": "completed", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:01.180857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:01.182557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:01.182557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:01.201035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] Creating event network-vif-plugged:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:22:01.212419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-dfc95601-3eb7-40a3-8639-f723f687fe48 req-113f8d0a-7e78-4b99-8641-fdedc99dd260 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060458 Aug 17 16:22:01.213382 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 376/750] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:22:01.291316 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:01.302466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3ef7e698-25d8-4903-8554-117011e70ca9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.231894 Aug 17 16:22:01.304616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 375/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:01 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:01.584574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:01.585927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:01.593146 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:01.593629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:01.594061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:01.594896 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:01.595355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:01.595771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:01.766710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:01.775568 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:01.777454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:01.778814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-717de7f2-3e7c-4567-ab52-af4f03767621 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.201068 Aug 17 16:22:01.797308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 377/752] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:01 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:02.326393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:02.327033 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:02.335649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:02.336417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:02.337317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:02.338083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:02.338547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:02.339615 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:02.502145 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:02.510236 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-df5962be-d398-4c22-aa6f-f0c62adf64a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.188731 Aug 17 16:22:02.511791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 376/753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:02 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:02.805145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:02.806434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:02.814083 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:02.814566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:02.815000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:02.815714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:02.816194 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:02.816620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:02.988971 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:03.001909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:03.003671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:03.005112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-16192a29-b44f-47be-9c44-217f001d5235 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.203948 Aug 17 16:22:03.025190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 378/754] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:02 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:03.233688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451c11ba-c2a2-49aa-8535-3ba1d2fa55f5", "name": "network-vif-plugged", "status": "completed", "tag": "d1692859-377d-4bc7-aad0-fe9cba24a28d"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:03.242997 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:03.247362 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:03.247362 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:03.256351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] Creating event network-vif-plugged:d1692859-377d-4bc7-aad0-fe9cba24a28d for instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 on hv-cinder-85220 Aug 17 16:22:03.262523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-6ade68de-3fbd-4e79-8d81-b481fcd2486b req-a7ad0c6d-4ce7-4e18-8bd8-235437579177 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Aug 17 16:22:03.263129 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 377/755] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:03.533525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:03.539521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:03.549585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:03.550329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:03.550766 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:03.551478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:03.551948 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:03.552376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:03.737319 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:03.749159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0c72308d-3385-40d5-96cb-200941291269 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.219874 Aug 17 16:22:03.749752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 379/756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:03 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:22:04.033609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:04.035058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:04.045453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:04.045941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:04.046379 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:04.047079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:04.047533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:04.047983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:04.205627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:04.214405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:04.216134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:04.217325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-42b50394-8c35-4038-a62f-69929d146ad6 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.189913 Aug 17 16:22:04.223456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 378/757] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:04 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:04.770550 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:04.772120 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:04.793633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:04.794137 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:04.794572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:04.811887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:04.812727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:04.813371 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:04.984437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:04.992341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f3097dfc-c21c-49e3-8737-a33fc9106de7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1265 microversion: 2.1 time: 0.225604 Aug 17 16:22:04.992933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 380/758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:04 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:05.245535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:05.245535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:05.278277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:05.278849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:05.280131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:05.280958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:05.282574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:05.284095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:05.455890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:05.467973 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:05.469631 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:05.470779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-072a9a8a-e27f-4bb1-9199-418589e0ec6c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.232935 Aug 17 16:22:05.471595 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 379/759] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:05 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:06.014631 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:06.015243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:06.022831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.023343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.023786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.024588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.025015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.025443 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.184856 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:06.192753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-34333202-3d64-49ef-a8ec-99c9574e8064 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1453 microversion: 2.1 time: 0.182043 Aug 17 16:22:06.212647 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 381/760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:06 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:06.219253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:06.219918 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:06.226459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.226956 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.227389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.228126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.228960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.229245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.397251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:06.413483 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-74a4386e-e4db-4b8e-8693-3e78dbf458e4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1453 microversion: 2.1 time: 0.198392 Aug 17 16:22:06.424281 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 380/761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:06 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:06.499163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:06.499779 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:06.503102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:06.509775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.510531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.511733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.512541 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:06.513232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:06.514126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:06.713905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:06.729008 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:06.732038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:06.733852 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7a64218b-d0da-432d-9ac2-35a78abee125 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.239372 Aug 17 16:22:06.734649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 382/762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:06 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:07.761446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:07.762237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:07.772964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:07.774363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:07.774814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:07.775545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:07.776905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:07.777354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:08.014501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:08.025387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:08.027849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:08.029249 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b954e54e-50ee-4264-820d-39e495358776 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.272409 Aug 17 16:22:08.039982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 381/763] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:07 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:08.680463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451c11ba-c2a2-49aa-8535-3ba1d2fa55f5", "tag": "d1692859-377d-4bc7-aad0-fe9cba24a28d"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:08.695935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:08.695935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:08.695935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:08.705489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] Creating event network-changed:d1692859-377d-4bc7-aad0-fe9cba24a28d for instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 on hv-cinder-85220 Aug 17 16:22:08.711310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-780a1266-cc6b-4a02-b8f4-424a41861f97 req-fcc7aad3-b12a-4f8e-8e7c-34563bc53314 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034470 Aug 17 16:22:08.712418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 383/764] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:09.059255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:09.060120 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:09.063616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:09.067101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:09.067584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:09.068053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:09.068749 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:09.069380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:09.069800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:09.204357 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:09.212584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:09.214704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:09.215869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-06402926-c690-428b-a817-6e9e89d2a8ad tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1739 microversion: 2.20 time: 0.161195 Aug 17 16:22:09.216431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 382/765] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:09 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:10.238952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:10.239642 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:10.247034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:10.247508 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:10.247978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:10.248659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:10.249110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:10.249523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:10.383818 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:10.391788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:10.393313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:10.394452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-192788f2-a212-4d00-9a72-a021c456199e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1721 microversion: 2.20 time: 0.159760 Aug 17 16:22:10.395011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 384/766] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:10 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:11.416720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:11.417313 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:11.423696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:11.424196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:11.424621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:11.425293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:11.425744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:11.426174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:11.430122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=100 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:11.561909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:11.569760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:11.571239 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:11.572606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ea565cfd-3afe-4150-a189-a2d9b9f007b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1721 microversion: 2.20 time: 0.159588 Aug 17 16:22:11.574197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 383/767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:11 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:12.597634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:12.598276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:12.605104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:12.605592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:12.606024 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:12.606721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:12.607171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:12.607587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:12.735890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:12.739341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=100 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:12.744610 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:12.746869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:12.748052 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-558c4b1c-d9d7-4fe5-a948-1c92f32b2ed7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1664 microversion: 2.20 time: 0.154686 Aug 17 16:22:12.748606 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 385/768] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:12 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:12.771108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b5a31f4-7155-43bc-bb53-cdad12abdf2c"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:12.773491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:12.780314 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:12.780799 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:12.781234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:12.781925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:12.782381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:12.782807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.049221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-80214ed2-0ea3-45b3-8b90-2e5daa08e369 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282073 Aug 17 16:22:13.049937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 384/769] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 17 16:22:12 2022] POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 16:22:13.171629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:13.172157 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:13.178260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.178740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.179174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.179880 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.180331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.180749 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.428999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9aaa147c-319c-4708-919c-392b5e4bc133 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments/6b5a31f4-7155-43bc-bb53-cdad12abdf2c" status: 202 len: 0 microversion: 2.20 time: 0.261921 Aug 17 16:22:13.429584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 386/770] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 17 16:22:13 2022] DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments/6b5a31f4-7155-43bc-bb53-cdad12abdf2c => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:22:13.488816 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:13.489429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:13.495521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.496071 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.496499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.497176 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.497623 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.498038 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.529527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120793) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 16:22:13.594216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f718bbc9-359a-4fa1-b633-00ca32549974 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/action" status: 202 len: 0 microversion: 2.20 time: 0.109248 Aug 17 16:22:13.594848 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 385/771] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 17 16:22:13 2022] POST /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:22:13.603597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:13.605015 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:13.611788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.612298 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.612731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.613420 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:13.613872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:13.614322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:13.750813 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:13.759263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:13.761502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:13.762986 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-13b87702-f789-42ed-b5e1-023e15b489ed tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1672 microversion: 2.20 time: 0.163568 Aug 17 16:22:13.763762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 387/772] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:13 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:14.786434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:14.787163 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:14.794074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:14.794552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:14.795034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:14.795896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:14.796187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:14.796611 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:14.931702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:14.942262 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:14.943847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:14.945011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-038457fa-5baa-4fe7-a75d-2996a24fe2d9 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.163034 Aug 17 16:22:14.945576 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 386/773] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:14 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:15.120528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "name": "network-vif-unplugged", "status": "completed", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:15.132739 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:15.133501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:15.133991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:15.147064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] Creating event network-vif-unplugged:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:22:15.153593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-ae605319-ac06-442f-8ef1-01a1cffa36e4 req-96a7b91b-2a01-40ce-9099-3482956c3f8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036683 Aug 17 16:22:15.154368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 388/774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:15.970338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:15.972365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:15.982702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:15.983334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:15.983877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:15.984658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:15.985182 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:15.985872 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:16.148518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:16.165966 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:16.168488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:16.169705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c6debd03-a13e-447e-b762-542871cfafe7 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.204702 Aug 17 16:22:16.170268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 387/775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:15 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:17.195628 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:17.196423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:17.203138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:17.203621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:17.204086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:17.204988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:17.205445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:17.205867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:17.346961 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:17.356120 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:17.357929 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:17.359463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b5014bcb-8eaf-442a-b3a8-3f3d2650d2fd tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.168458 Aug 17 16:22:17.375592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 389/776] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:17 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:18.383032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:18.383627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:18.391073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:18.391552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:18.392016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:18.392707 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:18.393153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:18.393570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:18.533667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:18.542233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:18.543747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:18.545566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-197c140f-1cb7-4c93-975e-ce8b954be70b tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.166345 Aug 17 16:22:18.546267 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 388/777] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:18 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:19.576572 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:19.577187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:19.595512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:19.596293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:19.596729 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:19.597458 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:19.597882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:19.598306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:19.739470 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:19.748360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:19.749920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:19.751086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-81745998-97f1-4087-9d4d-62925c98bb67 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.184741 Aug 17 16:22:19.756526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 390/778] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:19 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:20.774586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:20.775849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:20.782474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:20.782948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:20.783392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:20.784101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:20.784550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:20.784964 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:20.926181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:20.934563 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:20.937488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:20.938670 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0ea117fb-4849-4af5-ba3e-959a5a2e318d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.168043 Aug 17 16:22:20.939386 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 389/779] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:20 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:21.965455 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:21.966770 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:21.975240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:21.975723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:21.976185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:21.976879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:21.977333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:21.977756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:22.115485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:22.124864 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:22.126593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:22.127964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ebd17b6b-1865-4096-b41d-64b672d46dfc tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.169354 Aug 17 16:22:22.128745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 391/780] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:21 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:23.151329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:23.152005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:23.158974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:23.159456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:23.159984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:23.160682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:23.161135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:23.161553 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:23.306485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:23.315854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:23.317328 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:23.318643 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bae7c4b8-ca5d-4c7c-a911-b8fed67b8a33 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.171344 Aug 17 16:22:23.319406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 390/781] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:23 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:24.342981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:24.343563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:24.350962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:24.351435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:24.351990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:24.352707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:24.353154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:24.353587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:24.487053 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:24.495080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:24.496586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:24.497905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4a577722-f5e1-42e9-97c5-c4aca053fa80 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.159486 Aug 17 16:22:24.498463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 392/782] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:24 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:25.522932 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:25.523855 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:25.530322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:25.530800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:25.531265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:25.532094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:25.532697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:25.533435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:25.674696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:25.684095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:25.686703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:25.687887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-958b772b-1ce0-41b6-bfd4-706800e0499d tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.169349 Aug 17 16:22:25.688436 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 391/783] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:25 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:26.710829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:26.711490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:26.718133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:26.718605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:26.719032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:26.719714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:26.720190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:26.720607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:26.854066 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:26.862661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:26.864216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:26.865358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-348da053-8c3c-4d81-9682-4e651fbec438 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1730 microversion: 2.20 time: 0.158658 Aug 17 16:22:26.865917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 393/784] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:26 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:27.888946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:27.889549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:27.895941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:27.896412 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:27.896839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:27.897512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:27.897958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:27.898374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:28.026415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:28.034583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:28.036142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:28.037282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-06d8db3c-c733-4e3b-8b94-48dd8d272f53 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1717 microversion: 2.20 time: 0.152833 Aug 17 16:22:28.037833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 392/785] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:22:27 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:22:29.186613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "name": "network-vif-plugged", "status": "completed", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:29.196501 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:29.196978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:29.197405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:29.208636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] Creating event network-vif-plugged:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:22:29.213555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-ca46e9b1-5eaa-47c4-b06d-1b8fe2081f53 req-f90d3778-0b3d-45fd-9e33-41abc636fd2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Aug 17 16:22:29.214145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 394/786] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:32.794290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:32.794923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:32.801444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:32.801925 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:32.802361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:32.803050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:32.803616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:32.804073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:32.827744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2079596a-6e72-4004-a4c4-70d54f2f5b55 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/ips" status: 200 len: 146 microversion: 2.1 time: 0.037787 Aug 17 16:22:32.828365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 393/787] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:22:32 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:34.876175 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f4a2510-c155-4520-b50e-23619b448f78"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:34.878570 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:34.884715 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:34.885190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:34.885615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:34.886290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:34.886735 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:34.887150 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:35.146980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d400d012-da17-46e5-8226-fac7aab060c5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276248 Aug 17 16:22:35.147658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 395/788] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:22:34 2022] POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:22:42.677666 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:42.680376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:42.685650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:42.686135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:42.686578 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:42.713156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:42.750567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Going to try to stop instance {{(pid=120793) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 16:22:42.792729 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7c56a609-f278-418a-963b-a5533048c90c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action" status: 202 len: 0 microversion: 2.1 time: 0.118729 Aug 17 16:22:42.793480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 394/789] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:22:42 2022] POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:22:42.802543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:42.803413 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:42.805406 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=28 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:42.810947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:42.811437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:42.812418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:42.813517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:42.813924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:42.814353 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:42.949563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:42.958104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e278e038-81e7-4ab2-b01d-e2d9ebf83a44 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.160267 Aug 17 16:22:42.958664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 396/790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:42 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:43.980034 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:43.980728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:43.987341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:43.987834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:43.988274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:43.988957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:43.989411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:43.989833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:44.121368 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:44.130224 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1c041111-243f-4f43-946c-c90c129ee65f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.154423 Aug 17 16:22:44.130787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 395/791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:43 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:45.151860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:45.152470 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:45.159645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:45.160154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:45.160585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:45.161266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:45.161718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:45.162139 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:45.164668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:45.291597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:45.300472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6d21c837-f6d7-4dc3-93bc-4d1fc49acdc8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.152440 Aug 17 16:22:45.301042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 397/792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:45 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:46.320766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:46.321369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:46.328365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:46.328852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:46.329277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:46.329952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:46.330399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:46.330813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:46.461286 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:46.469827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2c5b48b3-a169-45ad-abb6-2174c8a9da99 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.152884 Aug 17 16:22:46.470393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 396/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:46 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:47.491245 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:47.491876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:47.498233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:47.498708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:47.499139 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:47.499835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:47.500287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:47.500704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:47.633248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:47.641280 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bf537ec8-8e20-4e0a-8d91-42a2326beac1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.154100 Aug 17 16:22:47.641915 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 398/794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:47 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:48.662895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:48.663508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:48.669871 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:48.670345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:48.670775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:48.671499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:48.671983 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:48.672406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:48.809016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:48.817646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e3d42391-3284-4ba8-9ff0-1fe35791d993 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.158549 Aug 17 16:22:48.818208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 397/795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:48 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:49.839381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:49.839826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:49.846702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:49.847184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:49.847616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:49.848326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:49.848782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:49.849201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:49.975304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:49.983287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3271696d-03c7-4383-94a9-1a03208e338b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.147877 Aug 17 16:22:49.984441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 399/796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:49 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:51.005895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:51.006492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:51.012518 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:51.012995 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:51.013426 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:51.014100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:51.014545 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:51.014967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:51.142011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:51.149858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ceb5218e-f753-4fe0-9921-e3435437a843 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.147841 Aug 17 16:22:51.150417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 398/797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:51 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:52.172431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:52.173039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:52.179440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:52.179943 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:52.180373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:52.181050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:52.181496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:52.181913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:52.312612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:52.320657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e360049a-fafd-47da-b727-4a4f84f4b581 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.152756 Aug 17 16:22:52.321225 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 400/798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:52 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:53.342358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:53.342928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:53.349733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:53.350207 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:53.350639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:53.351348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:53.351797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:53.352238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:53.483784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:53.491679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8b4421d0-d898-4eff-90a5-4a8fc26a90ca tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.153219 Aug 17 16:22:53.492276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 399/799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:53 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:54.513615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:54.514209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:54.521266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:54.521736 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:54.522160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:54.522835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:54.523280 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:54.523696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:54.658917 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:54.667081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0e901a3e-168e-4054-967d-1b763d821f8f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.157358 Aug 17 16:22:54.667639 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 401/800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:54 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:55.688438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:55.689105 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:55.695537 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:55.696050 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:55.696485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:55.697169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:55.697620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:55.698040 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:55.828477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:55.836646 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1e28e89d-8148-46b7-ad52-763ca636a242 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.152222 Aug 17 16:22:55.837295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 400/801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:55 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:56.858947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:56.859667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:56.866197 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:56.866673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:56.867109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:56.867782 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:56.868248 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:56.868661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:56.997395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:57.005922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0da0f65c-b42a-4911-8dd8-29b97903f50f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.151365 Aug 17 16:22:57.006486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 402/802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:56 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:58.026851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:58.027453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:58.034828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:58.035300 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:58.035727 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:58.036471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:58.036919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:58.037333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:58.164744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:58.173591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8bb110a2-2485-4e27-92d4-edec8080337c tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1724 microversion: 2.1 time: 0.150619 Aug 17 16:22:58.174157 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 401/803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:58 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:59.194701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:59.196427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:59.201965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:59.203178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:59.203609 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:59.204319 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:59.204768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:59.205186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:59.340872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:59.349316 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-54a0fb44-50d1-4d0e-b151-320aeb6bcd22 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1701 microversion: 2.1 time: 0.158533 Aug 17 16:22:59.349877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 403/804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:59 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:22:59.369660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:22:59.376589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:59.377065 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:59.377505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:59.399427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Going to try to start instance {{(pid=120793) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 16:22:59.440114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7277f111-2963-4cc7-a9ff-428e8859493b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action" status: 202 len: 0 microversion: 2.1 time: 0.074119 Aug 17 16:22:59.440702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 402/805] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:22:59 2022] POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:22:59.448656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:22:59.449201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:22:59.456515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:59.457247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:59.457811 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:59.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:22:59.460214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:22:59.460748 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:22:59.596665 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:22:59.605518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cc607cde-b488-4dca-8c09-78f3e522c9c6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1710 microversion: 2.1 time: 0.160605 Aug 17 16:22:59.606292 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 404/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:22:59 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:00.629127 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:00.629818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:00.635930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:00.636408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:00.636835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:00.637511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:00.637958 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:00.638374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:00.772670 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:00.784086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ad61f8c3-2ec2-4e64-b39c-816c758384e0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1710 microversion: 2.1 time: 0.160135 Aug 17 16:23:00.784649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 403/807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:00 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:01.806592 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:01.807204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:01.814440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:01.814919 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:01.815355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:01.816182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:01.816640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:01.817063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:01.948307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:01.956734 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9f169ffa-8b00-4dc4-bc85-0ed9fcc3a13d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1714 microversion: 2.1 time: 0.154162 Aug 17 16:23:01.957297 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 405/808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:01 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:06.444658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:06.446866 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:06.453986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.454461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.454901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.455586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.456077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.456499 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.485712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a25b0357-c67f-406e-8cbe-996f622d8171 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044959 Aug 17 16:23:06.486269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 404/809] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 17 16:23:06 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:06.548416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:06.548915 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:06.555387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.555885 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.556311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.556982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.557428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.557841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.584159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:23:06.662691 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c5ccd68d-8dbb-437a-9012-4bdef5f78bce tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 204 len: 0 microversion: 2.20 time: 0.118212 Aug 17 16:23:06.663305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 406/810] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 17 16:23:06 2022] DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 16:23:06.671533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:06.672446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:06.678288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.678756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.679190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.679900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:06.680345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:06.680759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:06.813093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:06.820908 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:06.822418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:06.823562 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ccbbca8f-e24a-4554-b142-e8b801a7ee5c tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.156013 Aug 17 16:23:06.824141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 405/811] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:06 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:23:07.847476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:07.848191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:07.854740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:07.855240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:07.855670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:07.856376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:07.856826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:07.857242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:07.985687 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:07.993548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:07.995044 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:07.996223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d46348d3-1b25-44ad-90cf-5f04accde5de tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1723 microversion: 2.20 time: 0.153375 Aug 17 16:23:07.996777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 407/812] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:07 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 16:23:09.021006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:09.021620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:09.028247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:09.029361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:09.029800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:09.031465 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:09.031592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:09.031988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:09.096296 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:09.104650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:09.106144 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79729883ac964badae04665e547634da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23a63f9104b44ff9afa19fc00dbbd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:09.107293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-08248893-c3cf-4799-b7a5-344f7f04f629 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 200 len: 1656 microversion: 2.20 time: 0.090746 Aug 17 16:23:09.107874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 406/813] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:09 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 16:23:09.160499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80dafe6-bdad-47e7-aaea-7bac9af16b69", "name": "network-vif-deleted", "tag": "8e05d111-aedb-4940-a795-ce4d15d3123b"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:09.170729 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:09.171980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:09.172437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:09.183926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] Creating event network-vif-deleted:8e05d111-aedb-4940-a795-ce4d15d3123b for instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 on hv-cinder-85220 Aug 17 16:23:09.189171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-855c1515-0430-49e6-8558-74baa1f1aceb req-36b8c10b-6881-4a70-a9a7-d015cf9c477a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 Aug 17 16:23:09.192968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 408/814] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:10.130604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:10.131845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:10.139340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:10.141077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:10.141982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:10.143019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:10.143914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:10.144527 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:10.158752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 HTTP/1.1 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:23:10.160841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:10.162383 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'd80dafe6-bdad-47e7-aaea-7bac9af16b69'} Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:23:10.163185 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:10.164778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:10.166449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:23:10.166449 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a65ee668-62a9-49f2-a311-49404fa167cf tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 404 len: 111 microversion: 2.20 time: 0.035909 Aug 17 16:23:10.174320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-52ef0790-afe8-45c9-be55-e17dc06eda66 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '.version_select at 0x7f9eea1c60d0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:10.178764 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 407/815] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:10 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:23:10.198032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-52ef0790-afe8-45c9-be55-e17dc06eda66 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287924582" status: 204 len: 0 microversion: 2.20 time: 0.029166 Aug 17 16:23:10.199168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 409/816] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Aug 17 16:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287924582 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 16:23:11.965998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:11.966497 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:11.973265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:11.973754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:11.974189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:11.974877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:11.975333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:11.975757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:11.989597 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 HTTP/1.1 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:23:11.991123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:11.992748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'd80dafe6-bdad-47e7-aaea-7bac9af16b69'} Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:23:11.993625 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:11.995134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:11.996654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:23:11.996654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0e68bc41-e12d-423a-b324-564679a291b4 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 404 len: 111 microversion: 2.20 time: 0.030459 Aug 17 16:23:11.996654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 408/817] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 17 16:23:11 2022] DELETE /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 16:23:12.002445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:12.003178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: d80dafe6-bdad-47e7-aaea-7bac9af16b69] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:12.009788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:12.010292 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:12.010725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:12.011405 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:12.011879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:12.012302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:12.025466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 HTTP/1.1 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:23:12.027064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:12.028889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'd80dafe6-bdad-47e7-aaea-7bac9af16b69'} Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:23:12.029763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. Aug 17 16:23:12.031922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:12.033195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance d80dafe6-bdad-47e7-aaea-7bac9af16b69 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:23:12.033195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b043987e-07fb-446c-9c4b-4da1d944ae96 tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69" status: 404 len: 111 microversion: 2.20 time: 0.031256 Aug 17 16:23:12.033195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 410/818] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:11 2022] GET /compute/v2.1/servers/d80dafe6-bdad-47e7-aaea-7bac9af16b69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:23:13.165839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:13.166317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:13.168665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=30 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:13.174634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:13.175107 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:13.175532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:13.176240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:13.176687 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:13.177100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:13.179780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:13.192966 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 HTTP/1.1 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:23:13.194538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.196208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '25fb5ec0-85bf-4268-a9ab-3d0f89924363'} Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:23:13.196979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.198189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.199376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:23:13.199376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6ec98997-1792-463c-9e32-6afe79d0a46e tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 404 len: 111 microversion: 2.20 time: 0.033861 Aug 17 16:23:13.199376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 409/819] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 17 16:23:13 2022] DELETE /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:23:13.204480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:13.205089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] [instance: 25fb5ec0-85bf-4268-a9ab-3d0f89924363] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:13.207434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:13.212913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:13.213392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:13.213824 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:13.214520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:13.214998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:13.215419 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:13.232055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] HTTP exception thrown: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Request method failure captured: Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 HTTP/1.1 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RQoG6nUydU2tPViHz-jFR3jFTp9VlDCzjUOilk9ylR2GkR4btJI5mXPSYNw-yE9N9FIQ4doqelOkxcmb6VpXBUya9Y22z3oZFnADU-VNS_r3vvGGjgIKguMVnOHzQzdpiTy9WJRTiBFbUB0kPbH77iy4wddfihuDstG1bjx-0anz8Y Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:23:13.233591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d23a63f9104b44ff9afa19fc00dbbd37", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d23a63f9104b44ff9afa19fc00dbbd37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: d23a63f9104b44ff9afa19fc00dbbd37 Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201709972 Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 79729883ac964badae04665e547634da Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201709972-project Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.235957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '25fb5ec0-85bf-4268-a9ab-3d0f89924363'} Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:23:13.240156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. Aug 17 16:23:13.242336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:23:13.244183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] Returning 404 to user: Instance 25fb5ec0-85bf-4268-a9ab-3d0f89924363 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:23:13.244183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a4b3af33-125f-4b2b-a2d5-3aa938b14ace tempest-AttachVolumeShelveTestJSON-1201709972 tempest-AttachVolumeShelveTestJSON-1201709972-project] 10.222.0.60 "GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363" status: 404 len: 111 microversion: 2.20 time: 0.035096 Aug 17 16:23:13.244183 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 411/820] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 17 16:23:13 2022] GET /compute/v2.1/servers/25fb5ec0-85bf-4268-a9ab-3d0f89924363 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:23:21.699514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0747bb64-c11d-4515-8df1-0ead2c2407e9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: .version_select at 0x7f9eea2b5160>, body: {"keypair": {"name": "tempest-keypair-1071231164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHoll6YCj/3p35923N5l1qaLpe3LOpW9A1vLGNYZgkTjB3AI82hwY4BZDcevCJJVm7YXX8CCU49oxN5pZWeFYUtd7BAQYXX/cyLwbt+a7YlVr0ACQbiAlCZO7eLxwI0OQ=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:21.715903 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0747bb64-c11d-4515-8df1-0ead2c2407e9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:23:21.719739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-0747bb64-c11d-4515-8df1-0ead2c2407e9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:23:21.743148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0747bb64-c11d-4515-8df1-0ead2c2407e9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166309 Aug 17 16:23:21.744093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 410/821] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:23:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:23.004931 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1543885233", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96dad238-7a65-4d36-9643-e1708863f579"}], "security_groups": [{"name": "tempest-securitygroup--44521930"}], "key_name": "tempest-keypair-1071231164", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:23.115377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] validate_networks() for [('96dad238-7a65-4d36-9643-e1708863f579', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:23:23.222777 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:23.752082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:23:23.752497 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:23:23.752966 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:23:23.753364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:23:23.753768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:23:23.762954 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:23.763423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:23.763873 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:23.764620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:23.765360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:23.765786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:23.782479 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:23:23.786433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:23:23.798087 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:23:23.800372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:23:23.865267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-50c1247d-2245-4112-a81f-d47ea0f8e4eb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.864199 Aug 17 16:23:23.866558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 412/822] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:23:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:23:23.878203 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ecd9c425-f336-4442-8502-e75f47233b42 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:23.878825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ecd9c425-f336-4442-8502-e75f47233b42 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:23.941214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ecd9c425-f336-4442-8502-e75f47233b42 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:23.950763 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ecd9c425-f336-4442-8502-e75f47233b42 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1242 microversion: 2.1 time: 0.077429 Aug 17 16:23:23.951337 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 411/823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:23 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:24.971797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:24.972449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:24.978821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:24.979305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:24.979733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:24.980448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:24.980902 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:24.981320 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:25.046555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:25.054329 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9cf718aa-4e43-4d68-b9de-227790339298 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1294 microversion: 2.1 time: 0.087209 Aug 17 16:23:25.054901 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 413/824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:24 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:26.077869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:26.078478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:26.084746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:26.085292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:26.085777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:26.086481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:26.086931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:26.087351 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:26.218728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:26.226374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e671f2fb-2eba-4d22-9798-befed47a10fb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.152871 Aug 17 16:23:26.227146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 412/825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:26 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:26.526483 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cbbfc2-960e-4958-b35b-1f290e5e9353", "tag": "542ce1f3-d41a-4ab4-905c-7d9949a2ba38"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:26.536945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:26.537521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:26.537958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:26.549123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] Creating event network-changed:542ce1f3-d41a-4ab4-905c-7d9949a2ba38 for instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 on hv-cinder-85220 Aug 17 16:23:26.553920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-4e8ad7ec-b61f-4b25-8c73-ce3d8ac9172b req-288a9003-a100-44da-addb-1b86b37e26b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Aug 17 16:23:26.554504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 414/826] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:27.250621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:27.251215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:27.258213 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:27.258691 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:27.259117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:27.259846 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:27.260272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:27.260684 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:27.415758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:27.425230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f096a3d2-a946-426a-a032-902fde67cf20 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.180860 Aug 17 16:23:27.425813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 413/827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:27 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:28.447231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:28.447947 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:28.454858 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:28.455593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:28.456064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:28.456955 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:28.457414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:28.457841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:28.597907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:28.605585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0fb6d4df-c7ea-4d34-b7fa-1b8a30db35c0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.162689 Aug 17 16:23:28.606164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 415/828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:28 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:29.627628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:29.628367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:29.634852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:29.635554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:29.636020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:29.636742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:29.637209 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:29.637645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:29.773299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:29.780857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-713ee80f-40cd-4510-9634-30ffed2e907d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.157632 Aug 17 16:23:29.781416 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 414/829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:29 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:30.801633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:30.802249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:30.808796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:30.809264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:30.809694 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:30.810378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:30.810827 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:30.811826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:30.945000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:30.953001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-45ca9229-ada8-491d-a8ba-c4a1e6288a7a tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.155202 Aug 17 16:23:30.953950 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 416/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:30 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:31.513895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cbbfc2-960e-4958-b35b-1f290e5e9353", "name": "network-vif-plugged", "status": "completed", "tag": "542ce1f3-d41a-4ab4-905c-7d9949a2ba38"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:31.525133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:31.525607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:31.526115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:31.541549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] Creating event network-vif-plugged:542ce1f3-d41a-4ab4-905c-7d9949a2ba38 for instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 on hv-cinder-85220 Aug 17 16:23:31.546642 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-72eb5456-3ee9-4b35-95a5-28faf3f9ea1d req-767c4141-63b9-4ec5-9f0f-24b44847f530 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036720 Aug 17 16:23:31.547225 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 415/831] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:31.978485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:31.979099 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:31.986253 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:31.986737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:31.987170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:31.987884 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:31.988340 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:31.988767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:32.119537 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:32.127765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-97643cc7-f51e-4b9f-a6bb-5c03d503b5ff tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1366 microversion: 2.1 time: 0.153167 Aug 17 16:23:32.128350 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 417/832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:31 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:33.149246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:33.149963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:33.157022 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:33.157491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:33.157915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:33.158592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:33.159036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:33.159450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:33.287870 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:33.295336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bd6f7f04-a311-4352-96b1-7fedc6a813b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1556 microversion: 2.1 time: 0.150148 Aug 17 16:23:33.296340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 416/833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:33 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:33.316923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:33.317418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:33.323740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:33.324243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:33.324669 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:33.325343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:33.325788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:33.326200 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:33.403221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-34cf13d8-f5e0-4973-a08e-84103cf014c1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090029 Aug 17 16:23:33.403963 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 418/834] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:23:33 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:34.378084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cbbfc2-960e-4958-b35b-1f290e5e9353", "tag": "542ce1f3-d41a-4ab4-905c-7d9949a2ba38"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:34.382839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:34.391081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:34.391560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:34.392009 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:34.404100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] Creating event network-changed:542ce1f3-d41a-4ab4-905c-7d9949a2ba38 for instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 on hv-cinder-85220 Aug 17 16:23:34.409712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-280e9121-e4f8-47ef-bcf1-6375887fc6bd req-e97a4cde-c989-41b8-b083-02a8fe4812b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035987 Aug 17 16:23:34.410952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 417/835] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:36.961284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:36.962041 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:36.968596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:36.969063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:36.975818 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:36.976294 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:36.976723 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:36.977427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:36.977875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:36.978289 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:37.060336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lazy-loading 'services' on Instance uuid c735bc06-0c92-4467-a715-bd5d0ea33927 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:23:37.133384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ee68137d-3e2e-4188-baba-cfe43b755938 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments/0f4a2510-c155-4520-b50e-23619b448f78" status: 202 len: 0 microversion: 2.1 time: 0.172728 Aug 17 16:23:37.133967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 419/836] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:23:36 2022] DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments/0f4a2510-c155-4520-b50e-23619b448f78 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:23:38.395255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:38.401355 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:38.401831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:38.402295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:38.424336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Going to try to stop instance {{(pid=120793) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 16:23:38.472798 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7ade872a-b46b-4a52-aabc-2f2e4449f4a5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action" status: 202 len: 0 microversion: 2.1 time: 0.082026 Aug 17 16:23:38.473516 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 418/837] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:23:38 2022] POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:23:38.484794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:38.485485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:38.491659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:38.492167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:38.492591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:38.493263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:38.493707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:38.494119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:38.628374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:38.635949 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d724e850-b449-4424-8af6-34e8c2caefc9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.158012 Aug 17 16:23:38.636521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 420/838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:38 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:39.659765 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:39.660473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:39.667095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:39.667552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:39.668010 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:39.668692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:39.669140 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:39.669557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:39.801534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:39.808963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d4561c05-37d2-4e94-9a0d-2bc54c36701a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.154587 Aug 17 16:23:39.809522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 419/839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:39 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:40.830869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:40.831476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:40.838887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:40.838887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:40.839238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:40.839963 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:40.840417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:40.840857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:40.973549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:40.981058 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-25d45636-75ab-4b46-8406-75ca3559fbeb tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.154700 Aug 17 16:23:40.981801 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 421/840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:40 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:42.007455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:42.008108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:42.014675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:42.015160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:42.015592 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:42.016325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:42.016778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:42.017200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:42.145869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:42.153218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6dc1b738-f752-4d7a-9491-71763a1f07e5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.149605 Aug 17 16:23:42.153777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 420/841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:42 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:43.175018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:43.175622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:43.182057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:43.182530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:43.182960 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:43.183649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:43.184127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:43.184548 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:43.311589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:43.319259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-04be5cd7-d1eb-4099-90b3-7a7e3fe2219d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.148057 Aug 17 16:23:43.319869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:43 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:44.340862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:44.341511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:44.345138 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:44.351177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:44.351676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:44.352126 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:44.352804 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:44.353253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:44.353668 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:44.484752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:44.492090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-18920671-9580-4eb9-81e5-d09d414f4d29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.154982 Aug 17 16:23:44.492645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 421/843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:44 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:45.176264 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-259447292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-965676027", "security_groups": [{"name": "tempest-secgroup-smoke-503595786"}], "block_device_mapping_v2": [{"uuid": "01608bb9-6ad5-4948-8583-4eebf0b15c5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6a03044-b6d5-4e67-9b08-ead35b439913"}]}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:45.186741 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:45.289415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] validate_networks() for [('f6a03044-b6d5-4e67-9b08-ead35b439913', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:23:45.514287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:45.514890 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:45.521271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:45.521756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:45.522195 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:45.522874 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:45.523329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:45.523746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:45.653832 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:45.658564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:23:45.658978 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:23:45.659443 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:23:45.659865 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:23:45.660376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:23:45.662936 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-70175ef6-9e73-4e1c-b1e8-5bcaeb6ed92f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.153003 Aug 17 16:23:45.663509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 422/844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:45 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:45.669065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:45.669539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:45.670071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:45.671061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:45.671508 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:45.671961 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:45.688767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:23:45.692662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Getting quotas for user 2f7f4cf57e814aebab32a56b19aa067f and project c9eb10c3ae444a9c8472e9961a4ca79e. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:23:45.748981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:23:45.751089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01608bb9-6ad5-4948-8583-4eebf0b15c5d',volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:23:45.880750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5145d378-1239-461f-ac49-76ca1b2e500c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708224 Aug 17 16:23:45.881407 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 423/845] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:23:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:23:45.892818 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-57275060-96d8-45b5-93ef-d2024b76fa6f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:45.893431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-57275060-96d8-45b5-93ef-d2024b76fa6f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:45.944641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-57275060-96d8-45b5-93ef-d2024b76fa6f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:45.952047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-57275060-96d8-45b5-93ef-d2024b76fa6f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1093 microversion: 2.1 time: 0.063156 Aug 17 16:23:45.952725 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 423/846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:45 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:46.684185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:46.684795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:46.691594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:46.692105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:46.692530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:46.693210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:46.693654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:46.694067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:46.827743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:46.835427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3ae3aae6-b146-4f3b-94d9-7c3b216b637d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.155027 Aug 17 16:23:46.836047 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 424/847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:46 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:46.972889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:46.973490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:46.979819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:46.980308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:46.980733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:46.981407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:46.981852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:46.982873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:47.050042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:47.057544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-388c792e-a8e5-4f32-b4d8-82d3ee9f2a96 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1191 microversion: 2.1 time: 0.088681 Aug 17 16:23:47.058113 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 424/848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:46 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:47.858189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:47.858800 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:47.867100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:47.868106 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:47.869483 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:47.870431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:47.871043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:47.871775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:48.079420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:48.080692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:48.087250 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:48.087678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:48.088151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:48.088852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:48.089310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:48.089732 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:48.113544 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:48.122601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-de0d47c7-febe-4866-80ff-1ece4c6dbe01 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.269439 Aug 17 16:23:48.125224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 425/849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:47 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:48.225356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:48.233854 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bd13f3f0-87d6-48e0-a368-2852fe1579f7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.159030 Aug 17 16:23:48.234430 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 425/850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:48 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:48.568759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89414431-1381-42e1-b6df-44e6ce09e904", "tag": "a2732191-cb46-497c-80b6-27efd4963d11"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:48.579899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:48.580376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:48.580791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:48.750500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] Creating event network-changed:a2732191-cb46-497c-80b6-27efd4963d11 for instance 89414431-1381-42e1-b6df-44e6ce09e904 on hv-cinder-85220 Aug 17 16:23:48.755403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-57555f60-eb5e-4cd9-a0a9-530651ceb5bb req-704ee5aa-c500-4c1d-8924-77871508917f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191364 Aug 17 16:23:48.756221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 426/851] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:23:49.145606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:49.146208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:49.152537 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:49.153029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:49.153454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:49.154202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:49.154921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:49.155350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:49.255565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:49.256413 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:49.262907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:49.263457 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:49.263920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:49.264617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:49.265071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:49.265489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:49.284591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:49.292012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-332af47f-36c2-4393-b44c-c5a6fd49c65a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.150383 Aug 17 16:23:49.292583 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 426/852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:49 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:49.398619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:49.407144 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-dcfd76bf-0afb-44e5-a0cb-14d0a7b91160 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.155749 Aug 17 16:23:49.407708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 427/853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:49 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:50.314896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:50.315985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:50.322076 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:50.322529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:50.322974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:50.323665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:50.324202 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:50.324627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:50.428366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:50.428970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:50.436075 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:50.436555 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:50.436983 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:50.437678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:50.438155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:50.438576 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:50.458698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:50.466332 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9ee1e7eb-0e21-4aaf-bc7a-f4c191cf3f61 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.156022 Aug 17 16:23:50.466939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 427/854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:50 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:50.571317 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:50.579823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ce2ac2cc-f01e-4b75-bff2-6969f2b9a872 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.155232 Aug 17 16:23:50.580381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 428/855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:50 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:51.488631 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:51.489264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:51.495455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:51.495971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:51.496404 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:51.497089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:51.497567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:51.498066 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:51.600702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:51.601315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:51.607696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:51.608372 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:51.608803 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:51.609499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:51.609946 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:51.610364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:51.636679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:51.639443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:51.647129 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b5c64048-0cbb-46eb-b200-6386f7d5978f tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1678 microversion: 2.1 time: 0.162285 Aug 17 16:23:51.647711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 428/856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:51 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:51.740728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:51.748221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8d719bdd-5bb6-4db1-9729-3bc44f59e475 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.151285 Aug 17 16:23:51.748835 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 429/857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:51 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:52.669000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:52.670372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:52.678164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.678637 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.679091 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.679775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.680244 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.680656 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.769001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:52.769704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:52.776842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.777315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.777753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.778495 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.779472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.779930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.814239 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:52.821788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fa4eda27-a575-41a7-8096-888e8ac70f12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1655 microversion: 2.1 time: 0.156565 Aug 17 16:23:52.822376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 429/858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:52 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:52.842648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:52.849161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.849654 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.850088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.872814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Going to try to start instance {{(pid=120793) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 16:23:52.915770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4c73f3f6-24a7-4f46-9f33-a911fd9e49e2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action" status: 202 len: 0 microversion: 2.1 time: 0.077368 Aug 17 16:23:52.916422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 430/859] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:23:52 2022] POST /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:23:52.925514 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:52.926205 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:52.926357 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:52.929953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:52.932569 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.933093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.933558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.934477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:52.934935 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:52.935705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:52.935942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ba32ba36-b4d4-4941-a171-eccac0e8b7da tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.170596 Aug 17 16:23:52.936852 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 430/860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:52 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:53.071307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:53.082446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-59251ae2-2a11-494e-9f7e-d437db4df9b4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1664 microversion: 2.1 time: 0.159367 Aug 17 16:23:53.082446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 431/861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:52 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:53.957482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:53.958086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:53.965626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:53.966102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:53.967259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:53.968195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:53.968646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:53.969064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:54.099117 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:54.105139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:54.105833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:54.106704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-19e87a13-7b16-4190-9349-ecff0f6277fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.153376 Aug 17 16:23:54.107410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 431/862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:53 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:54.112450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:54.112941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:54.113377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:54.114074 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:54.114533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:54.114955 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:54.243437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:54.251635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-96c730ad-a97a-40c5-8eb2-2c8f9a5cfb26 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1664 microversion: 2.1 time: 0.150259 Aug 17 16:23:54.252230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 432/863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:54 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:55.128434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:55.129023 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:55.136241 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:55.136721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:55.137150 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:55.137833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:55.139000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:55.139682 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:55.273739 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:55.274377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:55.274992 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:55.281569 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8f205b8c-fe34-499c-a3ef-dc73847d50c6 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.157062 Aug 17 16:23:55.281742 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:55.282056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:55.282166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 432/864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:55 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:55.282494 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:55.283192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:55.283660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:55.284120 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:55.416510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:55.424432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a5a53ee3-102d-4b57-b834-d6f62efca4cf tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1668 microversion: 2.1 time: 0.153863 Aug 17 16:23:55.425006 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 433/865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:55 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:56.303287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:56.303924 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:56.305738 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:56.306390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:56.313327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:56.313807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:56.314238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:56.314922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:56.315369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:56.315789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:56.452182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:56.459648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8363e3f4-1a60-485e-92d6-bffa0b7ce536 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.160187 Aug 17 16:23:56.460243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 433/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:56 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:23:57.480338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:57.480950 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:57.482871 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:57.488511 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:57.488998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:57.489427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:57.490115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:57.490566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:57.490986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:57.624052 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:57.631517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3ca6234b-befd-4296-8f1c-efe9c6bcb1a8 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.154998 Aug 17 16:23:57.632109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 434/867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:57 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:58.652725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:58.653348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:58.660098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:58.660583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:58.661017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:58.661707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:58.662163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:58.662586 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:58.798033 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:23:58.805526 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0f36f9f7-9602-48fb-9cc4-56b9ea28c3a4 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.156678 Aug 17 16:23:58.806093 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 434/868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:58 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:23:59.672473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89414431-1381-42e1-b6df-44e6ce09e904", "name": "network-vif-plugged", "status": "completed", "tag": "a2732191-cb46-497c-80b6-27efd4963d11"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:23:59.682769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:59.683294 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:59.683769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:59.695812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] Creating event network-vif-plugged:a2732191-cb46-497c-80b6-27efd4963d11 for instance 89414431-1381-42e1-b6df-44e6ce09e904 on hv-cinder-85220 Aug 17 16:23:59.701596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-276ce952-c666-4d09-808e-1850795730eb req-6f616d0c-ef00-4b5c-bb9e-464cb7739879 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 Aug 17 16:23:59.702238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 435/869] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:23:59.826705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:23:59.827231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:23:59.833964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:59.834463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:59.834901 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:23:59.835624 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:23:59.836091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:23:59.836756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:00.006190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:00.013794 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e8c9abab-593c-4a0b-b5c4-38d2d7adc5c9 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.191762 Aug 17 16:24:00.014369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 435/870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:23:59 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:01.035148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:01.035853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:01.041957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:01.042434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:01.042859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:01.043536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:01.044016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:01.044686 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:01.178645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:01.187104 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1fb5cc94-43da-435e-85be-d0196b48ab63 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1264 microversion: 2.1 time: 0.156605 Aug 17 16:24:01.187660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 436/871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:01 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:02.208262 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:02.208899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:02.215281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:02.215754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:02.216224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:02.216939 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:02.218257 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:02.218751 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:02.351557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:02.359344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cc69ea7f-5b89-4140-95ae-f4a5e995631e tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1452 microversion: 2.1 time: 0.154922 Aug 17 16:24:02.359918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:02 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:02.379676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:02.380318 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:02.386741 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:02.387221 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:02.387657 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:02.388372 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:02.388832 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:02.389850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:02.519179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:02.526711 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f8ecac72-79ae-4c60-b8c9-922956dba031 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1452 microversion: 2.1 time: 0.150808 Aug 17 16:24:02.527278 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 437/873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:02 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:04.082869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89414431-1381-42e1-b6df-44e6ce09e904", "tag": "a2732191-cb46-497c-80b6-27efd4963d11"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:04.092910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:04.093319 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:04.093753 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:04.104920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] Creating event network-changed:a2732191-cb46-497c-80b6-27efd4963d11 for instance 89414431-1381-42e1-b6df-44e6ce09e904 on hv-cinder-85220 Aug 17 16:24:04.110340 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-0dac19a9-e08c-4a4d-9e03-4abb24e7297e req-479e79f1-442a-4ddf-874d-d3521d113fe5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031132 Aug 17 16:24:04.110949 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 437/874] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:24:10.530069 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:10.530699 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:10.537450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:10.537930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:10.538361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:10.539044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:10.539490 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:10.539930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:10.564199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-348314be-c046-408b-ae37-25ae4e16f63b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/ips" status: 200 len: 150 microversion: 2.1 time: 0.037912 Aug 17 16:24:10.564778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 438/875] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:24:10 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:11.926578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2870591-9b68-4980-a5ba-2cb4c0a1288d"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:11.929018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:11.935152 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:11.936558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:11.937020 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:11.937710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:11.938168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:11.938594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:12.207124 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-829372a0-af35-46b6-ac67-40e4567b7ad9 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285378 Aug 17 16:24:12.207780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 438/876] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:24:11 2022] POST /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:19.729287 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-aba20278-37d5-4bf3-9bbc-409c7040a494 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: .version_select at 0x7f9eea2b5820>, body: {"keypair": {"name": "tempest-keypair-1851116960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGnrQhpl9Yt8lyDsqwPuZbyAGfC5EviPdZjJnUu+rl/Z0QRKlnMP2L5oA79NCzGq47KgLrWfIIedNMETzyq3nH5GIq7YLbygrZxECoHjk0v8mYvAAh3QNwaX8PwhWrwUw=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:19.736013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=38 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:19.747184 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-aba20278-37d5-4bf3-9bbc-409c7040a494 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:24:19.753143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-aba20278-37d5-4bf3-9bbc-409c7040a494 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:24:19.774201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-aba20278-37d5-4bf3-9bbc-409c7040a494 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048767 Aug 17 16:24:19.774776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 439/877] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:24:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:20.982331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-574407487", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96dad238-7a65-4d36-9643-e1708863f579"}], "security_groups": [{"name": "tempest-securitygroup--1080560074"}], "key_name": "tempest-keypair-1851116960", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:20.990537 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:21.085187 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] validate_networks() for [('96dad238-7a65-4d36-9643-e1708863f579', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:24:21.459969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:24:21.460394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:24:21.460865 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:24:21.461267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:24:21.461671 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:24:21.471481 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:21.471985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:21.472414 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:21.473131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:21.473578 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:21.473992 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:21.490721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:24:21.494664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:24:21.505791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:24:21.508176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:24:21.561936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-15ff764f-48b2-43b8-aa55-97ceab164e32 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585154 Aug 17 16:24:21.562848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 439/878] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:24:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 16:24:21.570575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:21.576192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-262cdb2c-6f02-409b-98c3-84284d5e516b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:21.576821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-262cdb2c-6f02-409b-98c3-84284d5e516b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:21.647326 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-262cdb2c-6f02-409b-98c3-84284d5e516b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:21.654881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-262cdb2c-6f02-409b-98c3-84284d5e516b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1241 microversion: 2.1 time: 0.085077 Aug 17 16:24:21.655694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 440/879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:21 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:22.675247 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:22.676114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:22.683445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:22.684154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:22.684704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:22.686055 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:22.686524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:22.686952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:22.757883 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:22.766484 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-087385af-016a-4597-9c76-24d05521f860 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1311 microversion: 2.1 time: 0.095803 Aug 17 16:24:22.767060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 440/880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:22 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:23.787700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:23.788939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:23.796554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:23.797037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:23.797468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:23.798160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:23.798605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:23.799024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:23.951945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:23.959580 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8df2f22a-4661-45a7-9ea4-74b96879dac5 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.175715 Aug 17 16:24:23.960293 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 441/881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:23 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:24.292403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5", "tag": "02df8a17-a397-4624-a36d-bf54c2cd954e"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:24.303623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:24.304360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:24.304930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:24.310585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:24.319218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] Creating event network-changed:02df8a17-a397-4624-a36d-bf54c2cd954e for instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 on hv-cinder-85220 Aug 17 16:24:24.324401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-62f704ff-2a61-46e3-891e-b6a354913e18 req-ed0fd796-4373-46d5-8b1e-1478aa13b74f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036937 Aug 17 16:24:24.324994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 441/882] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:24.980335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:24.980955 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:24.987644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:24.988154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:24.988586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:24.989309 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:24.989759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:24.990205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:25.119080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:25.126952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7716184a-8558-4ced-abb3-dd6d1fa36ba2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.150447 Aug 17 16:24:25.127519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 442/883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:24 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:26.148571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:26.149278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:26.157786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:26.158272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:26.158713 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:26.159411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:26.159891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:26.160323 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:26.377026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:26.384728 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-be94d85d-7a04-489a-abd0-e95725c66ae8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.240361 Aug 17 16:24:26.385299 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 442/884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:26 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:27.406689 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:27.407322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:27.413660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:27.414151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:27.414558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:27.415232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:27.415678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:27.416122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:27.542679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:27.550830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-43d3eb09-a581-4dbe-8b50-81de4f0ee0af tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.148629 Aug 17 16:24:27.551388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 443/885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:27 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:28.571640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:28.572214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:28.578746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:28.579217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:28.579643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:28.580353 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:28.580799 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:28.581213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:28.712510 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:28.720867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0e06924e-bdad-4e99-a528-1f4f8382dd1c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.153218 Aug 17 16:24:28.721423 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 443/886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:28 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:29.743796 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:29.744434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:29.750690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:29.751169 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:29.751604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:29.752327 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:29.752813 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:29.753240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:29.775468 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5", "name": "network-vif-plugged", "status": "completed", "tag": "02df8a17-a397-4624-a36d-bf54c2cd954e"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:29.791626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:29.792445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:29.793078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:29.804994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] Creating event network-vif-plugged:02df8a17-a397-4624-a36d-bf54c2cd954e for instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 on hv-cinder-85220 Aug 17 16:24:29.811387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-af0a1b31-374a-4397-8877-c42176cdacbd req-694a187a-60f1-4b44-a4a6-a64fd04296b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Aug 17 16:24:29.812324 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 444/887] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:24:29.892198 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:29.900779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-3a2c32fe-1614-49d1-b33b-f21602ae809e tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.160724 Aug 17 16:24:29.901344 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 444/888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:29 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:30.923617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:30.924440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:30.931140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:30.931615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:30.932081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:30.932764 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:30.933210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:30.933626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:31.066000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:31.073343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-80ef4cf1-6845-46c2-adf7-448795e355d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1367 microversion: 2.1 time: 0.154974 Aug 17 16:24:31.073898 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 445/889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:30 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:32.095680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:32.096359 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:32.098675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:32.103976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:32.104458 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:32.104895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:32.105589 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:32.106044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:32.106530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:32.236252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:32.243644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fb6299bb-c921-4236-891c-338ece197259 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1556 microversion: 2.1 time: 0.153058 Aug 17 16:24:32.244233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 445/890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:32 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:32.265031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:32.265547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:32.267623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:32.268290 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:32.274615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:32.275095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:32.275525 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:32.276243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:32.276688 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:32.277131 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:32.355126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bff59b7d-1651-44e7-9cc5-f642d327e4d1 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094756 Aug 17 16:24:32.355709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 446/891] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:24:32 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:33.282342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5", "tag": "02df8a17-a397-4624-a36d-bf54c2cd954e"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:33.292312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:33.292838 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:33.293211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:33.304971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] Creating event network-changed:02df8a17-a397-4624-a36d-bf54c2cd954e for instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 on hv-cinder-85220 Aug 17 16:24:33.310917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-84e420d1-18df-429a-a7ea-4ce35a4c93dd req-08cc1f2e-eb1f-4fe4-b324-4f43b4ec07ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033009 Aug 17 16:24:33.311519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 446/892] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:33.822090 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:33.824347 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:33.831774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:33.832296 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:33.833772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:33.834677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:33.835298 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:33.835923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:33.868395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6b833e0b-ebd4-440f-a6d4-3b761a167e12 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050880 Aug 17 16:24:33.869060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 447/893] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:24:33 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 16:24:33.933957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:33.935095 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:33.941370 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:33.941852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:33.942290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:33.942984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:33.943444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:33.943901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:33.969657 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:24:34.049906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b6197fc3-810a-4b01-9644-231797a5608b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 204 len: 0 microversion: 2.1 time: 0.119816 Aug 17 16:24:34.050733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 447/894] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:24:33 2022] DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:24:34.059238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:34.060694 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:34.067261 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:34.067781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:34.068259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:34.068962 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:34.069418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:34.069842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:34.209056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:34.216906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-13ce9514-515c-4fe2-8b69-f016aeddf398 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1674 microversion: 2.1 time: 0.161977 Aug 17 16:24:34.217561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 448/895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:34 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:35.239151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:35.239880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:35.246280 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:35.246766 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:35.247831 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:35.248704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:35.249160 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:35.249584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:35.391417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:35.398875 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ad1ee915-1bbe-4415-b002-4e78121467ad tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1674 microversion: 2.1 time: 0.163952 Aug 17 16:24:35.399438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 448/896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:35 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:36.422127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:36.423356 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:36.429861 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:36.430349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:36.430786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:36.431519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:36.432022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:36.432422 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:36.753224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:36.760887 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a86613b4-910a-4a6b-901c-175e817f71f6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1674 microversion: 2.1 time: 0.343196 Aug 17 16:24:36.761477 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 449/897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:36 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:37.785877 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:37.786470 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:37.792941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:37.793425 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:37.794603 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:37.795306 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:37.795767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:37.796296 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:37.866867 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:37.875093 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-af50509f-21df-4273-a10a-92e2eac69db2 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 200 len: 1606 microversion: 2.1 time: 0.092958 Aug 17 16:24:37.878004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 449/898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:37 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:37.893398 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c735bc06-0c92-4467-a715-bd5d0ea33927", "name": "network-vif-deleted", "tag": "eefc60df-73fc-4598-924f-cb507c23d5ce"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:37.905220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:37.905851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:37.906287 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:37.918163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] Creating event network-vif-deleted:eefc60df-73fc-4598-924f-cb507c23d5ce for instance c735bc06-0c92-4467-a715-bd5d0ea33927 on hv-cinder-85220 Aug 17 16:24:37.923731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-e5908a3d-1615-454a-80fc-9b99fc3bbef6 req-a837ee8e-8e4c-4eea-b4ca-c71bffb81ff0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Aug 17 16:24:37.924704 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 450/899] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:38.897290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:38.897896 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:38.904859 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:38.905335 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:38.905769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:38.906469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:38.906905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:38.907324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:38.920951 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 HTTP/1.1 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:24:38.922609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:24:38.924310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'c735bc06-0c92-4467-a715-bd5d0ea33927'} Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:24:38.925175 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:24:38.926541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:24:38.927712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:24:38.927712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-19954ecb-d070-40fe-bbd5-a54bfbf0039b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 404 len: 111 microversion: 2.1 time: 0.030733 Aug 17 16:24:38.927712 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 450/900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:38 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:24:38.934565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-cbb715b8-b758-462c-b454-0a4afbf2c0d5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '.version_select at 0x7f9eea265e50>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:38.954647 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-cbb715b8-b758-462c-b454-0a4afbf2c0d5 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373785002" status: 202 len: 0 microversion: 2.1 time: 0.025209 Aug 17 16:24:38.955727 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 451/901] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 17 16:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373785002 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:24:39.821628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-275d35bc-1677-4101-9417-18ec8461ee19 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: .version_select at 0x7f9eeeb85820>, body: {"keypair": {"name": "tempest-keypair-136144315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWydVPlgV2Fnvnd+TuIe9Hw7frrRpVHTzxS2o+71GXqI67tAjYbmYAitPPiDh4MO7YIQSKrL5zi37iZlVXepeLxkyl+gIE/ehjdboqk7TcBR0PL21BA9lGNCIjeU/4bCQ=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:39.837062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-275d35bc-1677-4101-9417-18ec8461ee19 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for project 70e2e41d5730457a93725abb31d0a672. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:24:39.841791 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-275d35bc-1677-4101-9417-18ec8461ee19 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for user b7f7896e070541c18b391ff71320bc9a and project 70e2e41d5730457a93725abb31d0a672. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:24:39.863652 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-275d35bc-1677-4101-9417-18ec8461ee19 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046030 Aug 17 16:24:39.864356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 451/902] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:24:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:41.128643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-10161426", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a9e1593-5ee1-4d66-98aa-a12dbf9a84d5"}], "security_groups": [{"name": "tempest-securitygroup--1229367597"}], "key_name": "tempest-keypair-136144315", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:41.231655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] validate_networks() for [('4a9e1593-5ee1-4d66-98aa-a12dbf9a84d5', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:24:41.600425 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:24:41.600850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:24:41.601330 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:24:41.601739 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:24:41.602154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:24:41.611581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:41.612096 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:41.612532 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:41.613259 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:41.613717 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:41.614145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:41.631127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for project 70e2e41d5730457a93725abb31d0a672. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:24:41.635140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Getting quotas for user b7f7896e070541c18b391ff71320bc9a and project 70e2e41d5730457a93725abb31d0a672. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:24:41.648276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:24:41.652242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:24:41.701533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6632156f-3b6d-45b9-9465-474ff7f7bc2a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577719 Aug 17 16:24:41.702272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 452/903] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:24:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:24:41.713502 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cc1b7e1f-6ffc-4b58-8385-e73887dff7a6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:41.714117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cc1b7e1f-6ffc-4b58-8385-e73887dff7a6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:41.771167 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-cc1b7e1f-6ffc-4b58-8385-e73887dff7a6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:41.777841 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cc1b7e1f-6ffc-4b58-8385-e73887dff7a6 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1235 microversion: 2.1 time: 0.068555 Aug 17 16:24:41.778508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 452/904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:41 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:42.799103 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:42.799709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:42.806049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:42.806532 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:42.806964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:42.807677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:42.808163 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:42.808600 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:42.907213 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:42.914792 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f6abde06-ea66-4c14-ba3f-f32d8ec1eb29 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1295 microversion: 2.1 time: 0.120005 Aug 17 16:24:42.915683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 453/905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:42 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:24:43.936584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:43.937190 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:43.943746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:43.944256 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:43.944698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:43.945392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:43.945845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:43.946265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:44.077959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:44.085736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-366229d3-09c9-4503-a78a-1ee2b0b9504e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.153816 Aug 17 16:24:44.086303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 453/906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:43 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:44.265223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90827cb5-3767-41bf-88d3-725d3b6a5ba6", "tag": "8b66e3fb-0b9f-444e-83df-c1d61c007e1d"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:44.276358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:44.276829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:44.277251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:44.289613 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] Creating event network-changed:8b66e3fb-0b9f-444e-83df-c1d61c007e1d for instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 on hv-cinder-85220 Aug 17 16:24:44.296463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-e96370d1-d0d1-4955-9415-313aea9ab322 req-fc4dfbec-88c1-4702-8e3d-ca9124d701c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Aug 17 16:24:44.297307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 454/907] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:45.106639 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:45.107252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:45.113663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:45.114137 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:45.114567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:45.115254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:45.115709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:45.116151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:45.250317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:45.258162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-380c09de-8b48-4439-97bf-ec39502b578b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.155552 Aug 17 16:24:45.258724 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 454/908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:45 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:46.280178 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:46.280872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:46.287215 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:46.287836 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:46.288283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:46.289114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:46.289569 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:46.289990 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:46.498799 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:46.506285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1321f2de-74c3-4b6b-b60d-692940a367f0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.231520 Aug 17 16:24:46.506859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 455/909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:46 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:47.527942 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:47.528601 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:47.535082 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:47.535564 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:47.536028 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:47.536715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:47.537168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:47.537587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:47.665054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:47.672945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-72b9cb16-1c26-44d1-bbca-7ab668bf9271 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.148935 Aug 17 16:24:47.673506 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 455/910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:47 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:48.693395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:48.694062 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:48.701089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:48.701567 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:48.702039 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:48.702713 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:48.703162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:48.703583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:48.833461 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:48.841360 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5df8bdc9-3ec4-429f-af29-2d925d25e618 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.151818 Aug 17 16:24:48.841869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 456/911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:48 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:49.862881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:49.863517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:49.865959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:49.871467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:49.872429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:49.872853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:49.873551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:49.874002 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:49.874423 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:49.878222 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90827cb5-3767-41bf-88d3-725d3b6a5ba6", "name": "network-vif-plugged", "status": "completed", "tag": "8b66e3fb-0b9f-444e-83df-c1d61c007e1d"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:49.889683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:49.890239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:49.890745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:49.903558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] Creating event network-vif-plugged:8b66e3fb-0b9f-444e-83df-c1d61c007e1d for instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 on hv-cinder-85220 Aug 17 16:24:49.908819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-1b0bbf6f-ddd3-4bf2-9ea7-f89f92fb0ac0 req-ec15936e-38a4-4322-8b26-76ee5d4e7945 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034722 Aug 17 16:24:49.909857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 457/912] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:24:50.008606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:50.016923 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-acd0818f-ae30-44ea-a93c-2b02a8715818 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.157949 Aug 17 16:24:50.017498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 456/913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:49 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:51.039867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:51.040561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:51.042449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:51.049673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:51.050088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:51.050517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:51.051201 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:51.051649 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:51.052094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:51.181857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:51.189564 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-32c9d35f-b5d4-4f07-895b-d37a011efa97 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1361 microversion: 2.1 time: 0.154390 Aug 17 16:24:51.190123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 458/914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:51 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:52.210856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:52.211521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:52.213375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.219415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:52.219913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:52.220343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:52.221024 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:52.221471 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:52.221887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:52.225723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.359193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:24:52.366601 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-61700468-40cb-49c4-b588-3e163b1278b9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1547 microversion: 2.1 time: 0.159736 Aug 17 16:24:52.367154 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 457/915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:24:52 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:24:52.387908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:24:52.388558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:24:52.390349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.390997 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.397130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:52.397612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:52.398043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:52.398733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:52.399184 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:52.399607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:52.477377 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f10ad60d-c96d-4871-b293-5ae3ef35ba21 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093489 Aug 17 16:24:52.477965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 459/916] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:24:52 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:24:53.395229 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90827cb5-3767-41bf-88d3-725d3b6a5ba6", "tag": "8b66e3fb-0b9f-444e-83df-c1d61c007e1d"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:24:53.405560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:24:53.406035 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:24:53.406462 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:24:53.417310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] Creating event network-changed:8b66e3fb-0b9f-444e-83df-c1d61c007e1d for instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 on hv-cinder-85220 Aug 17 16:24:53.423208 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-c92e3d3b-03ae-43bc-9eec-0376a191e3d4 req-97f757ae-c923-4af6-93de-09945f169a6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Aug 17 16:24:53.423821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 458/917] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:09.409598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:09.410374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=79 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:09.414637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:09.415130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:09.422557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.423396 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.423980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.425211 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.426010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.426595 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.451322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6e0f5771-76a7-4519-84ab-c6fae18e2a15 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/ips" status: 200 len: 148 microversion: 2.1 time: 0.042546 Aug 17 16:25:09.452013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 460/918] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:25:09 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:09.463618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2870591-9b68-4980-a5ba-2cb4c0a1288d"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:09.467058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:09.470113 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=5 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:09.470759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=7 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:09.477044 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.477529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.477965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.478659 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.479114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.479534 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.562759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: POST /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/os-volume_attachments HTTP/1.1 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 74 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:09.564753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {"volumeAttachment": {"volumeId": "c2870591-9b68-4980-a5ba-2cb4c0a1288d"}} Aug 17 16:25:09.566391 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'server_id': 'ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5', 'body': {'volumeAttachment': {'volumeId': 'c2870591-9b68-4980-a5ba-2cb4c0a1288d'}}} Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:09.567301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:09.568596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 400 to user: Invalid volume: volume c2870591-9b68-4980-a5ba-2cb4c0a1288d is already attached to instances: e6cbbfc2-960e-4958-b35b-1f290e5e9353 {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-91186af6-a912-41dd-b0e5-3f756c627b07 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106795 Aug 17 16:25:09.569888 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 459/919] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:25:09 2022] POST /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:25:09.574843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:09.575344 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:09.582274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.582761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.583195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.583956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.584411 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.584832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.611842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:25:09.688332 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-84e4fd9b-81d1-4396-b0dc-5ef9d0fb0f6b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 204 len: 0 microversion: 2.1 time: 0.116779 Aug 17 16:25:09.688869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 461/920] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:09 2022] DELETE /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:25:09.697027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:09.697702 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:09.705172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.705653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.706086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.706783 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:09.707233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:09.707658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:09.836757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:09.844809 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-1dc337d1-1658-4c9a-bfb9-35cd0322cd2b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1680 microversion: 2.1 time: 0.151717 Aug 17 16:25:09.845361 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 460/921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:09 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:10.866013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:10.866848 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:10.873108 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:10.873648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:10.874133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:10.874922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:10.875402 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:10.875920 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:11.005840 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:11.014074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e3a9db85-b3cc-4e09-880f-db55d12948aa tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1680 microversion: 2.1 time: 0.152482 Aug 17 16:25:11.014646 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 462/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:10 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:12.035585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:12.036230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:12.042629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:12.043238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:12.043736 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:12.045146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:12.045669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:12.046159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:12.115825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:12.123428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7e099a9d-b54c-46d4-a298-51760f3fe806 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 200 len: 1612 microversion: 2.1 time: 0.091615 Aug 17 16:25:12.124026 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 461/923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:12 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:12.223051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5", "name": "network-vif-deleted", "tag": "02df8a17-a397-4624-a36d-bf54c2cd954e"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:12.234088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:12.234587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:12.234996 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:12.248957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] Creating event network-vif-deleted:02df8a17-a397-4624-a36d-bf54c2cd954e for instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 on hv-cinder-85220 Aug 17 16:25:12.254424 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-845b4db1-532d-4dcd-90ac-714bb1a4eaaf req-5ccd220b-b602-448e-b3a2-3b399b34e818 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035325 Aug 17 16:25:12.255048 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 463/924] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:13.146510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:13.147312 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:13.155618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:13.156011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:13.156444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:13.157138 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:13.157594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:13.158013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:13.172366 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 HTTP/1.1 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:13.173899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:25:13.175418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5'} Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:13.176302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:25:13.177755 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:13.179083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:13.179083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a5b29496-75c3-4bc7-bab4-4b6fd6c7cf1f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 404 len: 111 microversion: 2.1 time: 0.033810 Aug 17 16:25:13.179083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 462/925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:13 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:13.184739 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-db1895f0-961f-40cd-842b-0b1d63e40990 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '.version_select at 0x7f9eea265310>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:13.204478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-db1895f0-961f-40cd-842b-0b1d63e40990 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851116960" status: 202 len: 0 microversion: 2.1 time: 0.023839 Aug 17 16:25:13.205064 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 464/926] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 17 16:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851116960 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:25:14.128504 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:14.128999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:14.134881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:14.135365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:14.135819 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:14.136513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:14.136974 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:14.137401 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:14.216677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lazy-loading 'services' on Instance uuid e6cbbfc2-960e-4958-b35b-1f290e5e9353 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:14.287092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2e281c28-e1d4-43fc-b6d2-41ddfdfb1934 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments/c2870591-9b68-4980-a5ba-2cb4c0a1288d" status: 202 len: 0 microversion: 2.1 time: 0.162271 Aug 17 16:25:14.287673 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 463/927] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:25:14 2022] DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments/c2870591-9b68-4980-a5ba-2cb4c0a1288d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:25:14.297332 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:14.299594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:14.306485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:14.306967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:14.307400 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:14.308134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:14.308596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:14.309012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:14.338373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-de1db258-3438-4d15-aabb-c2f4039dd521 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 Aug 17 16:25:14.339209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 465/928] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:14 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:15.352156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:15.354467 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:15.361406 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.361891 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.362324 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.363013 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.363464 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.363914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.392965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-152716bc-a17a-4c60-9df9-813bb40b62fd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045653 Aug 17 16:25:15.393714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 464/929] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:15 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:25:15.455027 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:15.455533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:15.461894 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.462370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.462796 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.463475 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.463952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.464369 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.489869 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:25:15.567281 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-05365657-b780-4d6b-a122-34feb7c6c184 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 204 len: 0 microversion: 2.1 time: 0.115871 Aug 17 16:25:15.568294 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 466/930] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:15 2022] DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:25:15.577061 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:15.578032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:15.583928 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.584407 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.584839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.585526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:15.585977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:15.586396 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:15.716433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:15.731458 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7cd80d67-3659-4200-951b-61d03ae23c08 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1681 microversion: 2.1 time: 0.158747 Aug 17 16:25:15.732113 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 465/931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:15 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:16.752441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:16.753081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:16.759542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:16.760140 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:16.760602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:16.761293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:16.761747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:16.762172 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:16.894370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:16.901826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c18b79f5-4f57-4415-87a6-589204969645 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1681 microversion: 2.1 time: 0.153766 Aug 17 16:25:16.902391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 467/932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:16 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:17.923408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:17.923979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:17.930245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:17.930719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:17.931143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:17.931845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:17.932289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:17.932704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:18.068617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:18.076508 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-79d61a32-a1ab-4091-b0d0-a8ba4b32d6d8 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 200 len: 1681 microversion: 2.1 time: 0.157621 Aug 17 16:25:18.077064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 466/933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:17 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:18.395957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cbbfc2-960e-4958-b35b-1f290e5e9353", "name": "network-vif-deleted", "tag": "542ce1f3-d41a-4ab4-905c-7d9949a2ba38"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:18.408696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:18.409254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:18.409740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:18.422308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] Creating event network-vif-deleted:542ce1f3-d41a-4ab4-905c-7d9949a2ba38 for instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 on hv-cinder-85220 Aug 17 16:25:18.428397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-f83db507-0c68-4e69-b40a-0f988e2baa48 req-c63d69a2-9612-4034-80f0-87492af99486 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Aug 17 16:25:18.429711 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 468/934] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:19.098159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:19.099339 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:19.105726 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:19.106205 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:19.107164 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:19.108101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:19.108558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:19.108979 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:19.122265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 HTTP/1.1 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:19.124480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:25:19.125954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'e6cbbfc2-960e-4958-b35b-1f290e5e9353'} Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:19.126705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:25:19.127988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:19.129089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:19.129089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bfcdb7df-376d-4272-b4be-5af8f7e27ccd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 404 len: 111 microversion: 2.1 time: 0.032117 Aug 17 16:25:19.129089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 467/935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:19 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:25:19.135867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9a6c1a93-9ec5-434e-8795-6f6380a528b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '.version_select at 0x7f9eea2659d0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:19.156520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9a6c1a93-9ec5-434e-8795-6f6380a528b7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071231164" status: 202 len: 0 microversion: 2.1 time: 0.024866 Aug 17 16:25:19.157113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 469/936] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 17 16:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071231164 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:25:19.785725 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7f7b27ed-57b7-4b1c-bc9a-fdf8099436b0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: .version_select at 0x7f9eea3ffdc0>, body: {"keypair": {"name": "tempest-keypair-691630040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5KfEo5w5qnlcHwgCOman7d7sK0ra5bwCZ8CWKO2jAvXj6MqkLjGGl975OokwlaHTNcwWpW3WMpoDIN7o+EDBlFg2Jd9RqiJZp7aMoFomM3ouZ1qrkjWCIUIhsjMDhlvA=="}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:19.801103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-7f7b27ed-57b7-4b1c-bc9a-fdf8099436b0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:25:19.804885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-7f7b27ed-57b7-4b1c-bc9a-fdf8099436b0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:25:19.826409 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7f7b27ed-57b7-4b1c-bc9a-fdf8099436b0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043852 Aug 17 16:25:19.826999 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 468/937] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:25:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:21.062773 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-650091715", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96dad238-7a65-4d36-9643-e1708863f579"}], "security_groups": [{"name": "tempest-securitygroup--1632235608"}], "key_name": "tempest-keypair-691630040", "user_data": "}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:21.164968 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.network.neutron [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] validate_networks() for [('96dad238-7a65-4d36-9643-e1708863f579', None, None, None, None, None)] {{(pid=120794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:25:21.526951 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:25:21.527378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image limits 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:25:21.527890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:25:21.528304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image pref 0:0:0 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:25:21.528976 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.virt.hardware [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:25:21.540190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:21.540672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:21.541105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:21.541832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:21.542283 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:21.542707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:21.560658 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:25:21.564675 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:25:21.575721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Going to run 1 instances... {{(pid=120794) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:25:21.578094 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:25:21.623615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b8fbcd8f-1a93-46a9-ac1f-f43d45200d78 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566363 Aug 17 16:25:21.624512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 470/938] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:25:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:25:21.640697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c06cb1ff-dd50-4e7a-a627-d4ea5f494532 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:21.641864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c06cb1ff-dd50-4e7a-a627-d4ea5f494532 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:21.698333 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c06cb1ff-dd50-4e7a-a627-d4ea5f494532 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:21.705310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c06cb1ff-dd50-4e7a-a627-d4ea5f494532 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1240 microversion: 2.1 time: 0.072796 Aug 17 16:25:21.705901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 469/939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:21 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:25:22.727057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:22.727672 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:22.735070 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:22.735712 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:22.736390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:22.737265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:22.737770 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:22.738176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:22.820485 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:22.829032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ed0e777c-9098-41b7-b534-18e8b5527ff2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1310 microversion: 2.1 time: 0.106422 Aug 17 16:25:22.829611 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 471/940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:22 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:23.850557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:23.851162 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:23.857629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:23.858103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:23.858539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:23.859223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:23.859669 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:23.860118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:23.989115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:23.996591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7970ddb3-e2cc-4c84-9758-ac8e70081ec0 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.149849 Aug 17 16:25:23.997650 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 470/941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:23 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:24.105404 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536", "tag": "d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:24.117607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:24.118078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:24.119237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:24.131714 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] Creating event network-changed:d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0 for instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 on hv-cinder-85220 Aug 17 16:25:24.136870 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-7e82369d-9352-4d32-869c-ebe6091675e8 req-6c27f5f8-141e-4605-8f7b-395160260377 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 Aug 17 16:25:24.137511 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 472/942] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:25.018744 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:25.019363 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:25.025881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:25.026358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:25.026793 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:25.027484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:25.027970 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:25.028418 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:25.159627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:25.167033 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5739c6ce-9a11-479f-8381-3459ac5ed7f6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.152125 Aug 17 16:25:25.167606 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 471/943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:25 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:26.189740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:26.190439 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:26.197275 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:26.197761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:26.198196 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:26.198889 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:26.199345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:26.199769 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:26.558004 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:26.565478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6c6bd45e-1b7c-4b72-b3e6-3b0c301d819d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.380815 Aug 17 16:25:26.566040 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 473/944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:26 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:27.586468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:27.587079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:27.593757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:27.594477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:27.594965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:27.595599 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:27.596073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:27.596487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:27.724666 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:27.731986 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-92562bff-c964-40aa-ba4b-ab38e58076a3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.149262 Aug 17 16:25:27.733352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 472/945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:27 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:28.755134 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:28.755726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:28.763310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:28.764847 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:28.765573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:28.766502 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:28.766956 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:28.767378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:28.906912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:28.915376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3f5ee77f-1d2a-47ce-8249-1ccdc54f1c39 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.165269 Aug 17 16:25:28.915973 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 474/946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:28 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:29.499191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:29.499872 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:29.508122 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:29.508621 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:29.509253 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:29.509954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:29.510411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:29.510834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:29.538455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b76ee4ce-11e3-4c9a-844b-21862f4e26ee tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/ips" status: 200 len: 145 microversion: 2.1 time: 0.043234 Aug 17 16:25:29.539031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 473/947] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:25:29 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:29.937125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:29.937743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:29.944633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:29.945119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:29.946209 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:29.946923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:29.947421 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:29.948079 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:30.078507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:30.086057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-af182727-c3a9-45eb-95ce-0c3fb9395915 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.153505 Aug 17 16:25:30.086634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 475/948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:29 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:30.104073 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536", "name": "network-vif-plugged", "status": "completed", "tag": "d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:30.114988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:30.115472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:30.115927 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:30.128946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] Creating event network-vif-plugged:d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0 for instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 on hv-cinder-85220 Aug 17 16:25:30.133808 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-031dd7c1-4a67-4db0-980c-c1ec9825483b req-8223ad77-5268-4112-9678-9eeb1bc505b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 Aug 17 16:25:30.134389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 474/949] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:30.876907 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e579d2-ce21-4976-aa6b-967ade340b8b"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:30.879300 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:30.885199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:30.885670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:30.886100 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:30.886774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:30.887220 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:30.887637 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:31.108573 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:31.109272 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:31.115399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:31.115911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:31.116342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:31.117023 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:31.117472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:31.117889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:31.312951 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:31.322893 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8bb46627-e74b-4d4c-aef2-b132fcaf83dc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1366 microversion: 2.1 time: 0.219102 Aug 17 16:25:31.323453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 475/950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:31 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:25:31.403440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:31.414031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-20412db0-b59b-4604-8b3d-2b4eb5a9748a tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541277 Aug 17 16:25:31.414659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 476/951] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:25:30 2022] POST /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:32.345628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:32.346279 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:32.348231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:32.354001 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:32.354478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:32.354909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:32.355594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:32.356069 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:32.356492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:32.489835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:32.497433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-87654c3f-ecb6-4c25-9d5d-5c5343f0d033 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1556 microversion: 2.1 time: 0.156207 Aug 17 16:25:32.498433 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 476/952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:32 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:32.516057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:32.516860 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:32.521449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:32.522035 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:32.529453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:32.529942 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:32.530374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:32.531081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:32.531519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:32.532153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:32.610789 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-3cbdf417-ce68-4c6b-aa8a-006b4c4f1721 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095991 Aug 17 16:25:32.611392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 477/953] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:25:32 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:33.782531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536", "tag": "d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:33.794381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:33.794771 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:33.795222 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:33.807234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] Creating event network-changed:d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0 for instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 on hv-cinder-85220 Aug 17 16:25:33.812435 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-c21cc333-8edf-40e0-97ef-65d7476f5d2e req-8c5e7d04-cfcc-4b62-a9e6-9faa31c3418a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Aug 17 16:25:33.813778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 477/954] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:38.949133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:38.951301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:38.958089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:38.958569 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:38.958999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:38.959678 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:38.960162 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:38.960579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:38.991267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-06b8bd65-0a2b-4ec9-bc4b-3bc578007733 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Aug 17 16:25:38.991841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 478/955] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:38 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:39.003466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:39.004083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:39.010264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:39.010747 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:39.011186 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:39.011898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:39.012356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:39.012783 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:39.041142 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cfbb9dcd-ad7e-4c63-80b5-34b19621b1fd tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b" status: 200 len: 194 microversion: 2.1 time: 0.042513 Aug 17 16:25:39.041721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 478/956] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 17 16:25:38 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:40.364343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061db40e-5c4e-4fbd-9f7e-08664c16f1ae"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:40.366627 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:40.368911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:40.374594 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:40.375082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:40.375593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:40.376211 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:40.376660 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:40.377110 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:40.643911 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-47ac3fb7-2287-4fef-8e38-9d8a0a1a5478 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "POST /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283647 Aug 17 16:25:40.644539 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 479/957] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:25:40 2022] POST /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:43.765963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:43.766444 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:43.769403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89414431-1381-42e1-b6df-44e6ce09e904", "tag": "a2732191-cb46-497c-80b6-27efd4963d11"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:43.770098 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:43.775429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:43.775941 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:43.776375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:43.777072 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:43.777523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:43.778141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:43.781499 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:43.782045 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:43.782536 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:43.783297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:43.797362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] Creating event network-changed:a2732191-cb46-497c-80b6-27efd4963d11 for instance 89414431-1381-42e1-b6df-44e6ce09e904 on hv-cinder-85220 Aug 17 16:25:43.805067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-f459a984-04fe-489b-919e-f45d3a859e0b req-e288fd4c-cf25-4006-bfb3-dbe25ac8def6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040235 Aug 17 16:25:43.806326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 480/958] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:43.807487 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:25:43.912694 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9bfe2709-3d29-409c-bb5a-5733e169ef2a tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "DELETE /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 204 len: 0 microversion: 2.1 time: 0.150000 Aug 17 16:25:43.914016 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 479/959] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:43 2022] DELETE /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:25:43.924038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:43.926141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:43.934231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:43.935422 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:43.935918 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:43.937142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:43.937648 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:43.938077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:44.074391 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:44.082466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8d4a575e-95fe-480c-8646-beadc037e084 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1576 microversion: 2.1 time: 0.163449 Aug 17 16:25:44.083043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 481/960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:43 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:45.104365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:45.105062 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:45.111385 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:45.111889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:45.113064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:45.113914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:45.114367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:45.114792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:45.248229 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:45.255912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fad506e4-38e4-4655-b321-97507cc6be3f tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1576 microversion: 2.1 time: 0.155717 Aug 17 16:25:45.256485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 480/961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:45 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:46.277897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:46.278518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:46.285839 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:46.286875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:46.286875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:46.287437 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:46.287914 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:46.288341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:46.357081 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89414431-1381-42e1-b6df-44e6ce09e904", "name": "network-vif-deleted", "tag": "a2732191-cb46-497c-80b6-27efd4963d11"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:46.367193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:46.367919 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:46.368535 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:46.380115 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:46.382985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] Creating event network-vif-deleted:a2732191-cb46-497c-80b6-27efd4963d11 for instance 89414431-1381-42e1-b6df-44e6ce09e904 on hv-cinder-85220 Aug 17 16:25:46.388069 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-2491e6f3-5fad-4a69-8b4b-aa29b3a3c000 req-171f2289-c9af-4fb4-bfd4-4d5bdd3d700a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Aug 17 16:25:46.388677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 481/962] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:46.389690 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-fa7ffaff-e272-4020-bce2-ce7220625865 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1391 microversion: 2.1 time: 0.115736 Aug 17 16:25:46.399938 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 482/963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:46 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1391 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:47.412069 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:47.412759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:47.418876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:47.419356 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:47.419787 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:47.420491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:47.420940 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:47.421360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:47.598194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:47.598674 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:47.599103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:47.599541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lazy-loading 'fault' on Instance uuid 89414431-1381-42e1-b6df-44e6ce09e904 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:47.639998 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:47.648292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a65f35e6-02aa-4659-a984-66451d039192 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 200 len: 1229 microversion: 2.1 time: 0.241501 Aug 17 16:25:47.648850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 482/964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:47 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 1229 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:48.208272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:48.211376 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:48.218010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.218505 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.219190 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.219893 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.220346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.220790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.250517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b4c2078f-8c8b-4c18-aa10-6895bb7bb13e tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047359 Aug 17 16:25:48.251067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 483/965] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:48 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:48.400976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:48.401469 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:48.407346 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.407856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.408294 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.408977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.409431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.409850 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.439084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-29296f78-648d-4370-90fb-7ed87e08e0c0 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b" status: 200 len: 194 microversion: 2.1 time: 0.042049 Aug 17 16:25:48.439683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 483/966] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 17 16:25:48 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:48.450343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:48.450867 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:48.456957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.457440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.457873 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.458558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.459011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.459428 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.538460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lazy-loading 'services' on Instance uuid 90827cb5-3767-41bf-88d3-725d3b6a5ba6 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:48.609519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-445a7a48-9f6c-4db6-bb5e-973cc0003dd3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b" status: 202 len: 0 microversion: 2.1 time: 0.162936 Aug 17 16:25:48.610105 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 484/967] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:25:48 2022] DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/78e579d2-ce21-4976-aa6b-967ade340b8b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:25:48.668954 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:48.669559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 89414431-1381-42e1-b6df-44e6ce09e904] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:48.676252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.676716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.677649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.678566 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:48.678952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:48.679385 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:48.693217 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] HTTP exception thrown: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Request method failure captured: Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 HTTP/1.1 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RTJ-G5S80RH1NV1ENS1BcpyMl1Cd9kdarMBO_f20JfzJLStQvCddizgn3joQ1OSKQ6mADbjQYHqI4uLrj_TkKSW3YQ6a5wIaE-MR-val5NjvRBLnvBgYPAIYJYLgQ8WrBjadOSUkaK-_60FxqT0lZBCD7oxoW35x_1MfDFm81OwZU8 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:48.694851 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c9eb10c3ae444a9c8472e9961a4ca79e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 2f7f4cf57e814aebab32a56b19aa067f Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. Aug 17 16:25:48.697952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '89414431-1381-42e1-b6df-44e6ce09e904'} Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:48.698881 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. Aug 17 16:25:48.700454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:48.701852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Returning 404 to user: Instance 89414431-1381-42e1-b6df-44e6ce09e904 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:48.701852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ed6ad081-9828-4e77-8959-079cb435527d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904" status: 404 len: 111 microversion: 2.1 time: 0.031179 Aug 17 16:25:48.701852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 484/968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:48 2022] GET /compute/v2.1/servers/89414431-1381-42e1-b6df-44e6ce09e904 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:25:50.783850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:50.785308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:50.792166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:50.792654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:50.793095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:50.793788 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:50.794242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:50.794664 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:50.824125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c3e00e0d-1ec7-4211-a560-d91014c69723 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/061db40e-5c4e-4fbd-9f7e-08664c16f1ae" status: 200 len: 194 microversion: 2.1 time: 0.044434 Aug 17 16:25:50.824724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 485/969] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 17 16:25:50 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/061db40e-5c4e-4fbd-9f7e-08664c16f1ae => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:50.835346 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:50.835943 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:50.842079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:50.842554 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:50.842981 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:50.843663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:50.844417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:50.844835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:50.926183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lazy-loading 'services' on Instance uuid 90827cb5-3767-41bf-88d3-725d3b6a5ba6 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:51.000057 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b0d98924-2d69-4286-b648-ab1486055bd7 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/061db40e-5c4e-4fbd-9f7e-08664c16f1ae" status: 202 len: 0 microversion: 2.1 time: 0.168757 Aug 17 16:25:51.000812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 485/970] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:25:50 2022] DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments/061db40e-5c4e-4fbd-9f7e-08664c16f1ae => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 16:25:51.780255 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:51.780758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:51.783591 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451c11ba-c2a2-49aa-8535-3ba1d2fa55f5", "tag": "d1692859-377d-4bc7-aad0-fe9cba24a28d"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:51.787380 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:51.788034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:51.788500 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:51.789267 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:51.789791 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:51.790306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:51.794020 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:51.795856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:51.795856 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:51.807538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] Creating event network-changed:d1692859-377d-4bc7-aad0-fe9cba24a28d for instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 on hv-cinder-85220 Aug 17 16:25:51.812326 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-f4f2325e-5182-4ad8-a2b3-a46a2baf3cf5 req-14efbc7d-0e94-4e97-80bc-eff8a4f88e27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032809 Aug 17 16:25:51.813250 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 486/971] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:51.819587 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:25:51.921306 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-62d073c4-a6ad-43ae-a6cb-b77b3f853c1c tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "DELETE /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 204 len: 0 microversion: 2.1 time: 0.145427 Aug 17 16:25:51.926826 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 486/972] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:51 2022] DELETE /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:25:51.933619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:51.934443 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:51.942759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:51.943348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:51.943788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:51.944614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:51.945064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:51.945541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.087215 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:52.095269 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-7ef8ce82-be09-4859-aaf4-b7d9b632d7fe tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1578 microversion: 2.1 time: 0.167215 Aug 17 16:25:52.095845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 487/973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:51 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:25:52.176403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:52.178674 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:52.185359 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.185905 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.186348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.187061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.187517 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.188098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.220556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-157dc62a-5341-4c7a-b0a9-f42f3d753b96 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049099 Aug 17 16:25:52.221145 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 487/974] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:52 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:25:52.335461 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:52.337777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:52.343731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.344521 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.344972 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.345676 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.346150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.346706 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.376436 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d66894e8-7d3b-45f6-a6e8-0890f53613a3 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045502 Aug 17 16:25:52.376985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 488/975] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:25:52 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:25:52.439984 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:52.441274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:52.447109 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.447595 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.448059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.448761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.449216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.449636 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.475193 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:25:52.554604 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-da343c39-d0b4-432d-9d3a-efb8126d48f4 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 204 len: 0 microversion: 2.1 time: 0.118221 Aug 17 16:25:52.555195 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 488/976] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:52 2022] DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:25:52.563484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:52.564117 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:52.571295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.572046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.572480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.573179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:52.573800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:52.574390 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:52.712827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:52.720688 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8d5aa3ba-d2ce-4976-aef6-f83a955b6685 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1671 microversion: 2.1 time: 0.161050 Aug 17 16:25:52.721288 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 489/977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:52 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:53.119315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:53.120034 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:53.126425 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:53.126936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:53.127365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:53.128311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:53.128862 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:53.129284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:53.133984 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:53.314847 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:53.322634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ba839f01-4b52-48b1-a7a4-522079e3a15d tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1578 microversion: 2.1 time: 0.207525 Aug 17 16:25:53.323243 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 489/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:53 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:53.742623 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:53.743230 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:53.749634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:53.750112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:53.750547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:53.751237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:53.751692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:53.752151 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:53.883170 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:53.890696 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4a10bb86-8cc7-4d43-ab7d-7110d88fb72d tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1671 microversion: 2.1 time: 0.152003 Aug 17 16:25:53.891259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 490/979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:53 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:54.343870 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:54.344750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:54.351520 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:54.352051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:54.352492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:54.353186 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:54.353644 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:54.354073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:54.488017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:54.495536 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b6705a96-ddce-470f-b375-8636123f8187 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1578 microversion: 2.1 time: 0.155624 Aug 17 16:25:54.496170 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 490/980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:54 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:54.913118 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:54.913733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:54.920168 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:54.920653 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:54.921092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:54.921778 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:54.922235 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:54.922665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:55.049101 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:55.057297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e7bae3bd-bdde-480c-b557-c1fc62fc47e9 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1671 microversion: 2.1 time: 0.148129 Aug 17 16:25:55.057858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 491/981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:54 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:55.517315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:55.517863 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:55.525011 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:55.525365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:55.525841 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:55.526565 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:55.527028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:55.527454 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:55.853654 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:55.860591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7cbdad2a-faa4-41ee-963f-ccf0bfaa9072 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1578 microversion: 2.1 time: 0.347206 Aug 17 16:25:55.861378 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 491/982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:55 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1578 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:56.078920 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:56.079714 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:56.087233 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.087972 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.088362 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.089141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.089665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.090161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.220834 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451c11ba-c2a2-49aa-8535-3ba1d2fa55f5", "name": "network-vif-deleted", "tag": "d1692859-377d-4bc7-aad0-fe9cba24a28d"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:56.232392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.234253 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.234795 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.243197 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:56.249786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] Creating event network-vif-deleted:d1692859-377d-4bc7-aad0-fe9cba24a28d for instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 on hv-cinder-85220 Aug 17 16:25:56.255390 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-ecd157eb-27e8-4e52-95f5-5eb748171259 req-c523dea1-ef3c-4b0e-a5c7-cef724ad3492 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142814 Aug 17 16:25:56.255679 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d620fcd6-808b-406c-9742-97e5611d4060 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1671 microversion: 2.1 time: 0.180022 Aug 17 16:25:56.256556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 492/983] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:25:56.256777 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 492/984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:56 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:56.883179 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:56.883906 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:56.890309 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.890790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.891221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.891945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.892507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.892833 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.926879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.927374 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.927820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.928442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lazy-loading 'fault' on Instance uuid 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:56.978762 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90827cb5-3767-41bf-88d3-725d3b6a5ba6", "name": "network-vif-deleted", "tag": "8b66e3fb-0b9f-444e-83df-c1d61c007e1d"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:25:56.991915 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:56.992682 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:56.993088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:56.995523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7f4cf57e814aebab32a56b19aa067f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:57.008586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] Creating event network-vif-deleted:8b66e3fb-0b9f-444e-83df-c1d61c007e1d for instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 on hv-cinder-85220 Aug 17 16:25:57.013921 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0d022135-85ce-4ec1-a11f-eeb4f66d7da3 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 200 len: 1397 microversion: 2.1 time: 0.132089 Aug 17 16:25:57.015121 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-29a44a5f-94d9-4619-afae-d3daa63c69b7 req-21966020-7a96-44a1-af8b-996b3507da48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041047 Aug 17 16:25:57.016263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 493/985] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:25:57.016554 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 493/986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:56 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 1397 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:57.279046 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:57.279743 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:57.286530 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:57.287043 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:57.287478 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:57.288196 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:57.288649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:57.289070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:57.321322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:57.321893 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:57.322331 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:57.322779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lazy-loading 'fault' on Instance uuid 90827cb5-3767-41bf-88d3-725d3b6a5ba6 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:25:57.367926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f7896e070541c18b391ff71320bc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e2e41d5730457a93725abb31d0a672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:25:57.375330 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-68a7e53b-47d0-4b97-88ce-4bb57cef8a41 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 200 len: 1325 microversion: 2.1 time: 0.101113 Aug 17 16:25:57.375907 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 494/987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:57 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:25:58.037232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:58.037763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:58.044258 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.044762 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.045192 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.045895 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.046341 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.046774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.060817 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] HTTP exception thrown: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Request method failure captured: Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 HTTP/1.1 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RTJ-G5S80RH1NV1ENS1BcpyMl1Cd9kdarMBO_f20JfzJLStQvCddizgn3joQ1OSKQ6mADbjQYHqI4uLrj_TkKSW3YQ6a5wIaE-MR-val5NjvRBLnvBgYPAIYJYLgQ8WrBjadOSUkaK-_60FxqT0lZBCD7oxoW35x_1MfDFm81OwZU8 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:25:58.062478 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c9eb10c3ae444a9c8472e9961a4ca79e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 2f7f4cf57e814aebab32a56b19aa067f Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. Aug 17 16:25:58.064104 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '451c11ba-c2a2-49aa-8535-3ba1d2fa55f5'} Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:58.065037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. Aug 17 16:25:58.067272 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.068652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Returning 404 to user: Instance 451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:58.068652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d80abcbf-3327-4f11-b25e-e8cbe4669ff7 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5" status: 404 len: 111 microversion: 2.1 time: 0.030702 Aug 17 16:25:58.068652 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 494/988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:58 2022] GET /compute/v2.1/servers/451c11ba-c2a2-49aa-8535-3ba1d2fa55f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:58.396614 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:58.397223 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:58.403727 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.404245 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.404680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.405503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.405970 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.406393 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.420814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 HTTP/1.1 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:58.422491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:25:58.424111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '90827cb5-3767-41bf-88d3-725d3b6a5ba6'} Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:58.425644 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:25:58.427174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.428833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:58.428833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ea0863e0-094a-4e12-bfab-b1a40ca2776b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 404 len: 111 microversion: 2.1 time: 0.031356 Aug 17 16:25:58.428833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 495/989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:58 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:58.435722 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3fcee9b-9c61-412d-bbe0-69471f0273f1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '.version_select at 0x7f9eea195ca0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:58.455786 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f3fcee9b-9c61-412d-bbe0-69471f0273f1 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136144315" status: 202 len: 0 microversion: 2.1 time: 0.025574 Aug 17 16:25:58.457025 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 495/990] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 17 16:25:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136144315 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:25:58.507427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:58.508037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:58.514037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.514593 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.515128 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.515898 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.516419 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.516911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.521769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:58.533967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] HTTP exception thrown: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Request method failure captured: Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef HTTP/1.1 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RTJ-G5S80RH1NV1ENS1BcpyMl1Cd9kdarMBO_f20JfzJLStQvCddizgn3joQ1OSKQ6mADbjQYHqI4uLrj_TkKSW3YQ6a5wIaE-MR-val5NjvRBLnvBgYPAIYJYLgQ8WrBjadOSUkaK-_60FxqT0lZBCD7oxoW35x_1MfDFm81OwZU8 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:25:58.535616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c9eb10c3ae444a9c8472e9961a4ca79e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 2f7f4cf57e814aebab32a56b19aa067f Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.537248 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '6f7b5e26-05a5-4931-9022-7bf936165fef'} Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:58.538096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.539358 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.540756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Returning 404 to user: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:58.540756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-05a1a2c6-dda5-4ebe-91b3-c145850cc531 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 404 len: 111 microversion: 2.1 time: 0.034664 Aug 17 16:25:58.540756 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 496/991] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:25:58 2022] DELETE /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:58.545927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:58.546543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] [instance: 6f7b5e26-05a5-4931-9022-7bf936165fef] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:25:58.552763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.553252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.553692 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.554395 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:25:58.554855 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:25:58.555279 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:25:58.572689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] HTTP exception thrown: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Request method failure captured: Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef HTTP/1.1 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RTJ-G5S80RH1NV1ENS1BcpyMl1Cd9kdarMBO_f20JfzJLStQvCddizgn3joQ1OSKQ6mADbjQYHqI4uLrj_TkKSW3YQ6a5wIaE-MR-val5NjvRBLnvBgYPAIYJYLgQ8WrBjadOSUkaK-_60FxqT0lZBCD7oxoW35x_1MfDFm81OwZU8 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:25:58.574599 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c9eb10c3ae444a9c8472e9961a4ca79e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c9eb10c3ae444a9c8472e9961a4ca79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c9eb10c3ae444a9c8472e9961a4ca79e Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-TestVolumeBootPattern-826525536 Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 2f7f4cf57e814aebab32a56b19aa067f Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-TestVolumeBootPattern-826525536-project Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.576239 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '6f7b5e26-05a5-4931-9022-7bf936165fef'} Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:25:58.577051 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. Aug 17 16:25:58.578387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:25:58.580507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Returning 404 to user: Instance 6f7b5e26-05a5-4931-9022-7bf936165fef could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:25:58.580507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-65f4c635-303a-481e-90df-858c31ba84cd tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef" status: 404 len: 111 microversion: 2.1 time: 0.033990 Aug 17 16:25:58.580507 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 496/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:25:58 2022] GET /compute/v2.1/servers/6f7b5e26-05a5-4931-9022-7bf936165fef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:59.892705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0a8be1b2-63d2-4bd4-9c66-859d7db52556 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] Calling method '.version_select at 0x7f9eea2b1f70>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:25:59.913637 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0a8be1b2-63d2-4bd4-9c66-859d7db52556 tempest-TestVolumeBootPattern-826525536 tempest-TestVolumeBootPattern-826525536-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-965676027" status: 202 len: 0 microversion: 2.1 time: 0.025054 Aug 17 16:25:59.918428 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 497/993] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Aug 17 16:25:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-965676027 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:26:01.378718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:01.379375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:01.392181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:01.393077 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:01.393302 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:01.394127 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:01.396308 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:01.396776 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:01.412388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 HTTP/1.1 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:01.413975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.415676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '90827cb5-3767-41bf-88d3-725d3b6a5ba6'} Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:01.419761 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.421394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.422941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:01.422941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a8a37f73-04a0-4b60-8463-01e99db71a39 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 404 len: 111 microversion: 2.1 time: 0.040939 Aug 17 16:26:01.422941 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 497/994] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:26:01 2022] DELETE /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:01.427345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:01.428077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: 90827cb5-3767-41bf-88d3-725d3b6a5ba6] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:01.435976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:01.436574 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:01.437084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:01.437857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:01.438386 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:01.438882 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:01.453675 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 HTTP/1.1 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:26:01.455320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.457581 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '90827cb5-3767-41bf-88d3-725d3b6a5ba6'} Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:01.458584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. Aug 17 16:26:01.459905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:01.461067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance 90827cb5-3767-41bf-88d3-725d3b6a5ba6 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:01.461067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9835ac6b-683c-4380-abe0-51003ec244d8 tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6" status: 404 len: 111 microversion: 2.1 time: 0.036172 Aug 17 16:26:01.461067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 498/995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:01 2022] GET /compute/v2.1/servers/90827cb5-3767-41bf-88d3-725d3b6a5ba6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:02.616282 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:02.619278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:02.626680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:02.627657 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:02.628821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:02.630038 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:02.630707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:02.631235 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:02.649191 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 HTTP/1.1 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:02.653028 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.654597 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'c735bc06-0c92-4467-a715-bd5d0ea33927'} Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:02.655549 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.657251 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.661561 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:02.663645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-241b0580-53f2-4e9b-8461-a770c69963db tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 404 len: 111 microversion: 2.1 time: 0.054199 Aug 17 16:26:02.664726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 498/996] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:26:02 2022] DELETE /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:26:02.676235 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:02.676900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] [instance: c735bc06-0c92-4467-a715-bd5d0ea33927] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:02.688234 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:02.688852 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:02.689345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:02.690150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:02.690677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:02.691165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:02.704970 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] HTTP exception thrown: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Request method failure captured: Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 HTTP/1.1 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RWOkEYuFzeyuZ6J3JSethNVzSg8Or-SvJkxzV0ztCf-cnKnCM_6QgEagVWw9qwl7REIgt1bDal47RoGgF_M74hpEt5fb3ojHUjXdWSVOD0wO_20DgfvVMbWh5t411NBrLqQhEtJxwr9AmRJTiZp-5mlCJvySzcimuHAvzxKHMbRFiE Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:26:02.707546 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70e2e41d5730457a93725abb31d0a672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70e2e41d5730457a93725abb31d0a672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 70e2e41d5730457a93725abb31d0a672 Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823388076 Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: b7f7896e070541c18b391ff71320bc9a Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeTestJSON-1823388076-project Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.709210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'c735bc06-0c92-4467-a715-bd5d0ea33927'} Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:02.710108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. Aug 17 16:26:02.711664 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:02.713079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] Returning 404 to user: Instance c735bc06-0c92-4467-a715-bd5d0ea33927 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:02.713079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b5cee396-27a5-481b-b401-d06155f3897b tempest-AttachVolumeTestJSON-1823388076 tempest-AttachVolumeTestJSON-1823388076-project] 10.222.0.60 "GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927" status: 404 len: 111 microversion: 2.1 time: 0.041579 Aug 17 16:26:02.713079 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 499/997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:02 2022] GET /compute/v2.1/servers/c735bc06-0c92-4467-a715-bd5d0ea33927 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:08.481697 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-caac5b13-ac66-410d-9783-74dd379c7792 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Action: 'create', calling method: .version_select at 0x7f9eea1ebc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-648537220", "metadata": {"Type": "work"}}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-caac5b13-ac66-410d-9783-74dd379c7792 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 121 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:08.504132 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-648537220", "metadata": {"Type": "work"}}} Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: Aug 17 16:26:08.505842 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-648537220', 'metadata': {'Type': 'work'}}}} Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise error Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.506910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 16:26:08.509273 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 16:26:08.513530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 16:26:08.513530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.513530 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-caac5b13-ac66-410d-9783-74dd379c7792 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.514556 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-caac5b13-ac66-410d-9783-74dd379c7792 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.227234 Aug 17 16:26:08.516118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 499/998] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 17 16:26:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 16:26:08.525473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-56948e56-f17a-4b98-9c11-1d61cc3e71ae tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Action: 'create', calling method: .version_select at 0x7f9eea2a6f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009208709", "metadata": {"Type": "work"}}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-56948e56-f17a-4b98-9c11-1d61cc3e71ae tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 120 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:26:08.530003 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009208709", "metadata": {"Type": "work"}}} Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:26:08.531350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2009208709', 'metadata': {'Type': 'work'}}}} Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise error Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi '0' Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.532380 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 16:26:08.534512 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 16:26:08.536019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 16:26:08.536019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.536019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-56948e56-f17a-4b98-9c11-1d61cc3e71ae tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.536019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-56948e56-f17a-4b98-9c11-1d61cc3e71ae tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009847 Aug 17 16:26:08.538064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 500/999] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 17 16:26:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 16:26:08.547655 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ddca347c-7f0d-4c66-bd51-b1d142dca184 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Action: 'create', calling method: .version_select at 0x7f9eea3b43a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1657492417", "metadata": {"Type": "work"}}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ddca347c-7f0d-4c66-bd51-b1d142dca184 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 119 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:08.556161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1657492417", "metadata": {"Type": "work"}}} Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: Aug 17 16:26:08.559427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1657492417', 'metadata': {'Type': 'work'}}}} Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise error Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi '' Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.561311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 16:26:08.564482 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 16:26:08.568142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 16:26:08.568142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.568746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ddca347c-7f0d-4c66-bd51-b1d142dca184 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.571043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ddca347c-7f0d-4c66-bd51-b1d142dca184 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032230 Aug 17 16:26:08.571043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 500/1000] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 17 16:26:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 16:26:08.581883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b42d2b69-8983-4276-a976-a4d24bd6b7b0 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Calling method '.version_select at 0x7f9eea2b1670>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:08.614367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-b42d2b69-8983-4276-a976-a4d24bd6b7b0 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] HTTP exception thrown: Volume tempest-invalid-787731678 could not be found. Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b42d2b69-8983-4276-a976-a4d24bd6b7b0 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-787731678 HTTP/1.1 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:26:08.616678 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Volume tempest-invalid-787731678 could not be found. Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'tempest-invalid-787731678'} Aug 17 16:26:08.618106 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-787731678 could not be found. (HTTP 404) (Request-ID: req-933a10ad-158d-4b50-b53f-68b0c79a995e) Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.618939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:26:08.620437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-787731678 could not be found. Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:08.621880 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-787731678 could not be found. Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-787731678 could not be found. Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b42d2b69-8983-4276-a976-a4d24bd6b7b0 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 404 to user: Volume tempest-invalid-787731678 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b42d2b69-8983-4276-a976-a4d24bd6b7b0 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-787731678" status: 404 len: 98 microversion: 2.1 time: 0.042814 Aug 17 16:26:08.623298 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 501/1001] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Aug 17 16:26:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-787731678 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 17 16:26:08.632444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-bf26c008-59e2-4a80-a646-1286333e6010 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004257 Aug 17 16:26:08.633012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 17 16:26:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 17 16:26:08.641901 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5b481383-917a-4164-a2f9-e79bac99a8d3 tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003805 Aug 17 16:26:08.642494 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 502/1003] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Aug 17 16:26:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 17 16:26:08.652017 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-01b04cdd-76b8-4d9e-855c-538a6e427f9c tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Calling method '.version_select at 0x7f9eea232e50>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:08.681620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-01b04cdd-76b8-4d9e-855c-538a6e427f9c tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] HTTP exception thrown: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-01b04cdd-76b8-4d9e-855c-538a6e427f9c tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: DELETE /compute/v2.1/os-volumes/c95103a0-adc1-4de4-ad3b-e898cf66897f HTTP/1.1 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:08.705387 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'c95103a0-adc1-4de4-ad3b-e898cf66897f'} Aug 17 16:26:08.707701 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. (HTTP 404) (Request-ID: req-db6fcbed-d946-48fa-9aca-24af642d03b5) Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.708603 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:26:08.709750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 16:26:08.710934 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-01b04cdd-76b8-4d9e-855c-538a6e427f9c tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 404 to user: Volume c95103a0-adc1-4de4-ad3b-e898cf66897f could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-01b04cdd-76b8-4d9e-855c-538a6e427f9c tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c95103a0-adc1-4de4-ad3b-e898cf66897f" status: 404 len: 109 microversion: 2.1 time: 0.059847 Aug 17 16:26:08.713285 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 502/1004] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:26:08 2022] DELETE /compute/v2.1/os-volumes/c95103a0-adc1-4de4-ad3b-e898cf66897f => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:08.718641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76b3f800-4a9c-44f9-822e-1b1800e90dcc tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Calling method '.version_select at 0x7f9eea2a6280>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:08.749586 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-76b3f800-4a9c-44f9-822e-1b1800e90dcc tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] HTTP exception thrown: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76b3f800-4a9c-44f9-822e-1b1800e90dcc tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Request method failure captured: Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/os-volumes/99420e90-cd05-44f9-b513-22d9428bc01d HTTP/1.1 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_Ragx2_LYQxdoaMSjpB7OIpLnfegaxZPTCIs0hZrkd7xO-CwmPosQyWsj-c10QjZ2j6waNlOWf_CUz-IZmEqtRbWByQflkDEHlibSls0aiB2GnUEX0rFMkuHRtQtLNt8WZlDKiNkRdl-hgjCr0f1BlaBUzcy4F8_RmsoUjen0OhfD7M Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:26:08.751567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4f3b12b73094c97b8caf8e0c4338060", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4f3b12b73094c97b8caf8e0c4338060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: b4f3b12b73094c97b8caf8e0c4338060 Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesNegativeTest-909956346 Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 8b13eddf479a45019df23e24764b7865 Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesNegativeTest-909956346-project Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '99420e90-cd05-44f9-b513-22d9428bc01d'} Aug 17 16:26:08.753232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. (HTTP 404) (Request-ID: req-82550ff4-62a9-4702-a32c-d805c23984b2) Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.754094 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:26:08.755618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 16:26:08.756985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76b3f800-4a9c-44f9-822e-1b1800e90dcc tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] Returning 404 to user: Volume 99420e90-cd05-44f9-b513-22d9428bc01d could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-76b3f800-4a9c-44f9-822e-1b1800e90dcc tempest-VolumesNegativeTest-909956346 tempest-VolumesNegativeTest-909956346-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/99420e90-cd05-44f9-b513-22d9428bc01d" status: 404 len: 109 microversion: 2.1 time: 0.038464 Aug 17 16:26:08.758166 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 503/1005] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:26:08 2022] GET /compute/v2.1/os-volumes/99420e90-cd05-44f9-b513-22d9428bc01d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:26:09.878892 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:09.879449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:09.886224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:09.886718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:09.887160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:09.887935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:09.888352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:09.888779 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:09.915897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-eeea8cbe-cb2a-4175-8938-1e3c3d93a422 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/ips" status: 200 len: 150 microversion: 2.1 time: 0.042203 Aug 17 16:26:09.922301 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 503/1006] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:26:09 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:11.269348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2105fcf0-c83e-4320-942c-64664d3fdecd"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:11.271700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:11.278011 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:11.278503 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:11.278960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:11.279640 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:11.280131 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:11.280559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:11.542218 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-855b2296-8ca1-4dd5-9d94-8957e205e4f4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277972 Aug 17 16:26:11.542887 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 504/1007] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:26:11 2022] POST /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:19.081712 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2105fcf0-c83e-4320-942c-64664d3fdecd"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:19.084660 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:19.087159 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:19.092577 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.092998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.093434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.094365 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.094824 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.095244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.176246 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: POST /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments HTTP/1.1 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 74 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:19.178056 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {"volumeAttachment": {"volumeId": "2105fcf0-c83e-4320-942c-64664d3fdecd"}} Aug 17 16:26:19.179662 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'server_id': 'd2a1e7ec-56b5-49ca-97e0-c2e9e8e11536', 'body': {'volumeAttachment': {'volumeId': '2105fcf0-c83e-4320-942c-64664d3fdecd'}}} Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:19.180633 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:19.182155 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 400 to user: Invalid volume: volume 2105fcf0-c83e-4320-942c-64664d3fdecd is already attached to instances: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-1af816ca-01e1-4c4e-907f-d963f375aefb tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101763 Aug 17 16:26:19.183618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 504/1008] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:26:19 2022] POST /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 16:26:19.245616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:19.246189 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:19.248102 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:19.253375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.253847 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.254892 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.255567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.256058 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.256476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.339510 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lazy-loading 'services' on Instance uuid d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:26:19.409596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-78d3d9c6-2ee1-42b5-8804-10eb956803d3 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments/2105fcf0-c83e-4320-942c-64664d3fdecd" status: 202 len: 0 microversion: 2.1 time: 0.168648 Aug 17 16:26:19.410194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 505/1009] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:26:19 2022] DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments/2105fcf0-c83e-4320-942c-64664d3fdecd => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:26:19.418758 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:19.420980 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:19.430031 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.430521 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.431133 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.432068 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:19.432630 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:19.433313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:19.466708 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-55216972-da42-4d53-9396-38516bf5c9b6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051853 Aug 17 16:26:19.467466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 505/1010] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:26:19 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:20.480374 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:20.482800 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:20.489322 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.489817 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.490235 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.490924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.491369 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.491784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.524827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0b3ba635-93bb-4b49-8897-bd162807dcce tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049192 Aug 17 16:26:20.525388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 506/1011] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:26:20 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:26:20.587456 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:20.588016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:20.594634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.595114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.595591 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.596307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.596783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.597210 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.622540 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:26:20.694787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-25657b18-e586-4845-a3cf-72d19b0afd4b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 204 len: 0 microversion: 2.1 time: 0.110773 Aug 17 16:26:20.695293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 506/1012] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:26:20 2022] DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 16:26:20.704068 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:20.704703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:20.711415 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.711931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.712360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.713037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:20.713485 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:20.713906 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:20.849284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:20.856948 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8cb3e8d2-6e6e-43ea-9611-13142515c61c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1681 microversion: 2.1 time: 0.156896 Aug 17 16:26:20.857505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 507/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:20 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:21.879356 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:21.880171 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:21.886574 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:21.887048 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:21.887476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:21.888199 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:21.888643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:21.889060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:22.020618 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:22.027994 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b1e3bcfc-25f4-44eb-be46-823412c8c6e6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1681 microversion: 2.1 time: 0.152932 Aug 17 16:26:22.028557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 507/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:21 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:23.049731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:23.050376 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:23.057952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:23.058434 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:23.058862 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:23.059558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:23.060053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:23.060463 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:23.190540 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:23.198706 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-af77b9ef-be6b-4a0e-81c6-db549c5d86d6 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1681 microversion: 2.1 time: 0.152918 Aug 17 16:26:23.199377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 508/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:23 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:23.981229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536", "name": "network-vif-deleted", "tag": "d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:23.994466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:23.996080 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:23.996930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:24.003515 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:24.016737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] Creating event network-vif-deleted:d81b7ed3-2c4b-4b01-97af-7ed4b8229ef0 for instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 on hv-cinder-85220 Aug 17 16:26:24.030702 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-8ee1859e-a773-4607-9697-13e609e2ce69 req-44cb0a42-b194-4155-93b1-6f877b03c411 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203249 Aug 17 16:26:24.035460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 508/1016] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:24.220408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:24.221049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:24.227560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:24.228083 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:24.228517 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:24.229214 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:24.229665 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:24.230088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:24.261634 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:24.262109 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:24.262544 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:24.262990 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lazy-loading 'fault' on Instance uuid d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:26:24.306804 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:24.315692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-017ba21c-f14d-4a04-b3bd-61b4bb05b4be tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 200 len: 1330 microversion: 2.1 time: 0.099430 Aug 17 16:26:24.316307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 509/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:24 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:25.339489 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:25.340125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:25.347096 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:25.347571 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:25.348067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:25.348743 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:25.349182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:25.349626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:25.362832 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 HTTP/1.1 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:26:25.364588 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:26:25.366231 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'd2a1e7ec-56b5-49ca-97e0-c2e9e8e11536'} Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:26:25.367122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:26:25.368602 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:26:25.369859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:26:25.369859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f3c21779-9399-459c-9fa7-0aa9008ab5cd tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 404 len: 111 microversion: 2.1 time: 0.031534 Aug 17 16:26:25.369859 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 509/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:25 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:25.374802 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b7e0596d-21a6-47d8-8bab-7c3dca174938 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '.version_select at 0x7f9eea2b1280>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:25.393308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b7e0596d-21a6-47d8-8bab-7c3dca174938 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691630040" status: 202 len: 0 microversion: 2.1 time: 0.022295 Aug 17 16:26:25.393858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 510/1019] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 17 16:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691630040 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:26:26.017185 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-50278257-f244-4706-95a0-a936753de048 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: .version_select at 0x7f9eea195b80>, body: {"keypair": {"name": "tempest-keypair-473856085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsFu2rF4BdyZQvLeYHoKHA36VcWoTJ3EObHlJEEUTwstlz6qy9aifZVfmE4AwwAZnYO79zgF2QtoxBhDC36oreKCZCKr5Gs70+O8Ejvjv7tHzgNT2QjEV39XFbdD4BIug=="}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:26.034433 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-50278257-f244-4706-95a0-a936753de048 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:26:26.037098 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-50278257-f244-4706-95a0-a936753de048 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:26:26.059763 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-50278257-f244-4706-95a0-a936753de048 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046370 Aug 17 16:26:26.060385 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 510/1020] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:26:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:27.805769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1973656575", "imageRef": "3bff5326-2adb-4281-9ef8-ed600e910d4b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96dad238-7a65-4d36-9643-e1708863f579"}], "security_groups": [{"name": "tempest-securitygroup--1223970475"}], "key_name": "tempest-keypair-473856085", "user_data": "}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:27.915759 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] validate_networks() for [('96dad238-7a65-4d36-9643-e1708863f579', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:26:28.409613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:26:28.410031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:26:28.411340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:26:28.411878 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:26:28.412295 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:26:28.420811 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:28.421277 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:28.421703 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:28.422412 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:28.422858 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:28.423271 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:28.440477 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:26:28.444784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Getting quotas for user efaa552d402646b28f2f52068558fce0 and project c0011ec6367f43859c048642b2c324a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:26:28.456216 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:26:28.458628 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bff5326-2adb-4281-9ef8-ed600e910d4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:26:28.506392 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4eee9111-f9ea-4178-9b91-900b567db37d tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706096 Aug 17 16:26:28.507299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 511/1021] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:26:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:26:28.518991 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-8285f20c-ddb5-4ed8-8f23-cfcbcb6547a2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:28.520821 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-8285f20c-ddb5-4ed8-8f23-cfcbcb6547a2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:28.578616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-8285f20c-ddb5-4ed8-8f23-cfcbcb6547a2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:28.586759 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-8285f20c-ddb5-4ed8-8f23-cfcbcb6547a2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1241 microversion: 2.1 time: 0.072258 Aug 17 16:26:28.587322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 511/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:28 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:29.610709 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:29.611389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:29.623715 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:29.624172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:29.624812 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:29.625557 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:29.626029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:29.626453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:29.697560 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:29.710481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fdca0f01-4016-42cf-961f-2c74a22a7d04 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1301 microversion: 2.1 time: 0.105699 Aug 17 16:26:29.711136 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 512/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:29 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:30.731128 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:30.731683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:30.738310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:30.739431 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:30.739882 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:30.740619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:30.741067 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:30.741488 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:30.987916 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:30.996364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9585e687-05e4-477e-8048-f8de8340cbca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.269057 Aug 17 16:26:30.996944 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 512/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:30 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:31.137618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb6dab6-9d40-4556-ae4d-92326671c2a8", "tag": "bafefd86-a6ac-41cd-90ac-f1fec271685f"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:31.157431 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:31.159693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:31.162399 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:31.168112 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:31.177420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] Creating event network-changed:bafefd86-a6ac-41cd-90ac-f1fec271685f for instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 on hv-cinder-85220 Aug 17 16:26:31.183533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-8e6944fa-250f-4230-9f13-4685918a3fef req-508309e1-5bbc-4f8f-afec-1f63363c5040 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049702 Aug 17 16:26:31.184338 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 513/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:32.026005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:32.027088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:32.033754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:32.034573 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:32.035010 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:32.035750 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:32.036224 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:32.036645 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:32.166445 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:32.174135 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-f3a86bf1-68e1-46a9-bc44-d60f02111dfc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.153152 Aug 17 16:26:32.174778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 513/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:32 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:33.195781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:33.196501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:33.203930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:33.204405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:33.204830 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:33.205509 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:33.205952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:33.206365 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:33.339389 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:33.347087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bfb0c23c-1da2-4a7c-a723-cdd4a8218f4f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.156287 Aug 17 16:26:33.348354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 514/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:33 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:34.369122 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:34.369731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:34.376000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:34.376487 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:34.376922 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:34.377616 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:34.378069 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:34.378490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:34.514875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:34.522260 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c656f7c5-d9d6-48de-8442-5b8d180791ca tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.157096 Aug 17 16:26:34.522823 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 514/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:34 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:35.546387 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:35.547588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:35.558123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:35.559251 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:35.560276 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:35.561710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:35.562474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:35.563187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:35.712914 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:35.720608 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bcb4b690-b52c-4a0c-b87d-b7e93d130e10 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.180429 Aug 17 16:26:35.721325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:35 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:36.742797 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:36.743410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:36.749912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:36.750394 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:36.750829 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:36.751519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:36.752009 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:36.752432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:36.882327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:36.889800 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-07007360-7d50-48d0-aa77-066878ccbbc2 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.151511 Aug 17 16:26:36.890364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 515/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:36 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:37.910302 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:37.910994 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:37.917760 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:37.918327 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:37.918828 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:37.919618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:37.920165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:37.920655 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:38.054340 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:38.061642 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-855df78d-e522-464f-a51c-afbd2b98a36c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.155342 Aug 17 16:26:38.062206 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 516/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:37 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:39.083435 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:39.084071 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:39.089785 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=6 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:39.091401 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:39.091912 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:39.092353 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:39.098313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:39.098790 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:39.101146 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:39.235909 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:39.243928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a63b8099-90d7-487d-8c72-ac40d1fff9bc tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.165038 Aug 17 16:26:39.244496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 516/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:39 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:40.265092 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:40.265692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:40.267617 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:40.268289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:40.275097 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:40.275568 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:40.276031 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:40.276705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:40.277148 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:40.277559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:40.407482 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:40.415616 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e4b6e8c7-cf78-498c-94e2-2048e8adc0cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.154385 Aug 17 16:26:40.416199 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 517/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:40 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:41.437001 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:41.437612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:41.444698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:41.445181 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:41.445620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:41.446364 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:41.446818 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:41.447237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:41.575057 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:41.583333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6fd35b5a-415a-4380-8fb6-a7e9aa2bf362 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.150099 Aug 17 16:26:41.583930 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 517/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:41 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:42.604472 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:42.605084 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:42.611424 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:42.611926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:42.612352 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:42.613053 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:42.614228 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:42.614845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:42.743360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:42.750700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e6d8e124-0ee9-45f5-ab0a-398f200f6a82 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.150078 Aug 17 16:26:42.751261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 518/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:42 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:43.073985 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb6dab6-9d40-4556-ae4d-92326671c2a8", "name": "network-vif-plugged", "status": "completed", "tag": "bafefd86-a6ac-41cd-90ac-f1fec271685f"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:43.086452 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:43.086939 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:43.087967 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:43.100012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] Creating event network-vif-plugged:bafefd86-a6ac-41cd-90ac-f1fec271685f for instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 on hv-cinder-85220 Aug 17 16:26:43.106130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-03a37447-4df8-41cd-beed-0a9fbbfb03e9 req-d35b43e8-743d-40ed-8960-02eb397eb41f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035471 Aug 17 16:26:43.106733 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 518/1036] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:43.770697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:43.771317 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:43.777745 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:43.778220 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:43.778649 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:43.779342 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:43.779792 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:43.780236 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:43.911618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:43.919032 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5533ed47-7e38-4dfe-ad65-b045e5c7c462 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.152442 Aug 17 16:26:43.919594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 519/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:43 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:44.940718 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:44.942167 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:44.949547 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:44.950029 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:44.950523 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:44.951217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:44.951670 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:44.952154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:45.090403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:45.098160 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e6d3278e-810f-428a-a5ac-81558c609ddf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1367 microversion: 2.1 time: 0.161798 Aug 17 16:26:45.098710 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 519/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:44 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:26:46.118648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:46.119263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:46.125987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:46.126474 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:46.126913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:46.127609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:46.128100 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:46.128531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:46.257541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:26:46.265042 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-081e7596-cbe8-4464-bc59-be26bd2005ea tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1557 microversion: 2.1 time: 0.150358 Aug 17 16:26:46.265619 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 520/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:26:46 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:26:46.285416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:26:46.286082 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:26:46.292668 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:46.293152 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:46.293589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:46.294280 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:46.294732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:46.295158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:46.371957 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7bd91aa9-3824-43d7-929c-e93bf1d5cd0f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090361 Aug 17 16:26:46.372558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 17 16:26:46 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:47.542537 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb6dab6-9d40-4556-ae4d-92326671c2a8", "tag": "bafefd86-a6ac-41cd-90ac-f1fec271685f"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:47.552570 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:26:47.553041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:26:47.553594 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:26:47.564494 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] Creating event network-changed:bafefd86-a6ac-41cd-90ac-f1fec271685f for instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 on hv-cinder-85220 Aug 17 16:26:47.570613 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-c32efd48-f251-4125-b4ce-bfee96c5c89a req-22a8aa7b-3da8-42ed-8321-c25d2216fafb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031679 Aug 17 16:26:47.571274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 521/1041] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:26:59.375333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:59.376959 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=51 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:59.564680 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-160308ab-7b60-49a1-b087-04434251ec2c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Action: 'create', calling method: .version_select at 0x7f9eea391c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1084596684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6Fa0c1NsEGWU33aUeByAq6NyiVOKEWHOjDUrljLmDV93F5HmPqPwApP+BvtIIai3bRExt3UbCiZ7kiOmCHe7unkGh9fEAXnoU095gcakACWt0P7wWMOncu+kjUz7K0wQ=="}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:26:59.581416 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-160308ab-7b60-49a1-b087-04434251ec2c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Getting quotas for project 035e36bbf4bc4c6384765fde5bde5b26. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:26:59.586512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.quota [None req-160308ab-7b60-49a1-b087-04434251ec2c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Getting quotas for user a4405fb9580444eda2c63017ebc41d78 and project 035e36bbf4bc4c6384765fde5bde5b26. Resources: {'key_pairs'} {{(pid=120794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:26:59.611656 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-160308ab-7b60-49a1-b087-04434251ec2c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.241641 Aug 17 16:26:59.612218 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 521/1042] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 17 16:26:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:27:16.867700 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-855269719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1084596684", "security_groups": [{"name": "tempest-secgroup-smoke-851144886"}], "networks": [{"uuid": "31b7498c-bfbd-4add-be8e-0375f45590cd"}], "block_device_mapping_v2": [{"uuid": "72809b1c-89b9-4d40-bece-0489fa5a861c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:16.878049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:16.878689 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=45 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:16.988048 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.network.neutron [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] validate_networks() for [('31b7498c-bfbd-4add-be8e-0375f45590cd', None, None, None, None, None)] {{(pid=120793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 16:27:17.348690 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Flavor limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 16:27:17.349110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Image limits 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 16:27:17.349585 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Flavor pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 16:27:17.349993 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Image pref 0:0:0 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 16:27:17.350429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.virt.hardware [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 16:27:17.362238 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:17.362719 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:17.363150 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:17.363904 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:17.364360 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:17.364780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:17.381892 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Getting quotas for project 035e36bbf4bc4c6384765fde5bde5b26. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 16:27:17.386343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.quota [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Getting quotas for user a4405fb9580444eda2c63017ebc41d78 and project 035e36bbf4bc4c6384765fde5bde5b26. Resources: {'cores', 'ram', 'instances'} {{(pid=120793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 16:27:17.442104 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Going to run 1 instances... {{(pid=120793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 16:27:17.444408 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72809b1c-89b9-4d40-bece-0489fa5a861c',volume_size=None,volume_type=None)] {{(pid=120793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 16:27:17.570049 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6bfc133d-4f28-47c5-899a-7d5f17e1a06c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706543 Aug 17 16:27:17.570699 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 522/1043] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 17 16:27:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 16:27:17.582072 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d86ff532-0770-4741-8e95-86fdf73c7ddc tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:17.582683 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d86ff532-0770-4741-8e95-86fdf73c7ddc tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:17.584804 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=4 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:17.585426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:17.644086 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d86ff532-0770-4741-8e95-86fdf73c7ddc tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:17.651313 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d86ff532-0770-4741-8e95-86fdf73c7ddc tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1088 microversion: 2.1 time: 0.073095 Aug 17 16:27:17.651894 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 522/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:17 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:18.673488 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:18.674099 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:18.680779 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:18.681261 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:18.681889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:18.682723 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:18.683194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:18.683590 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:18.748420 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:18.757647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-ac310dcc-9744-4bb4-a83d-54978f1681a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1186 microversion: 2.1 time: 0.088648 Aug 17 16:27:18.758297 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 523/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:18 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:27:19.780963 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:19.781550 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:19.788737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:19.789221 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:19.789653 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:19.790348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:19.791553 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:19.792118 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:20.016988 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:20.024693 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-7c9909f4-b35b-48aa-aa07-419f9dcbae23 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.247726 Aug 17 16:27:20.025910 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 523/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:19 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:27:20.474072 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:20.484414 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:20.484895 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:20.485341 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:20.496960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] Creating event network-changed:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:27:20.501774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-28df3515-8b2b-4f66-9887-8f774963026f req-aa6e3ffb-3086-4d8a-8815-3f6516cc2ef9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031383 Aug 17 16:27:20.502375 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 524/1047] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:21.047368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:21.047981 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:21.054542 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:21.055018 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:21.055444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:21.056156 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:21.057227 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:21.057686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:21.186780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:21.194214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-66adb1ce-d778-4eb6-ba8a-035a93cbf0da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.150802 Aug 17 16:27:21.194771 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 524/1048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:21 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:22.217141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:22.217827 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:22.224159 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:22.224629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:22.225054 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:22.225731 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:22.226177 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:22.226593 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:22.358768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:22.366161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-415c7909-ff0c-49b0-b20c-0b3dda98136f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.154418 Aug 17 16:27:22.366717 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 525/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:22 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:23.387347 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:23.388000 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:23.394495 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:23.394970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:23.395403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:23.396129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:23.396582 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:23.397003 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:23.530559 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:23.538050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d6972103-8669-4750-8440-5be464ec5773 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.154576 Aug 17 16:27:23.538621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 525/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:23 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:24.558559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:24.559161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:24.565604 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:24.566080 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:24.566507 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:24.567193 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:24.567643 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:24.568090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:24.701533 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:24.708934 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-9beea229-cf39-48ee-81ae-4b551c033657 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.154714 Aug 17 16:27:24.709505 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 526/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:24 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:25.505513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:25.506091 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:25.513168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:25.513651 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:25.514088 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:25.514780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:25.515233 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:25.515661 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:25.538125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a5a5a051-5b37-478a-9fa6-5ece4cd9159c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.036565 Aug 17 16:27:25.538689 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 526/1052] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:27:25 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:25.731692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:25.732441 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:25.739897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:25.740381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:25.740807 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:25.741493 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:25.742110 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:25.742823 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:25.889618 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:25.897849 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-34ea3159-a9ed-452e-a973-938c4e55e2b8 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.171921 Aug 17 16:27:25.898413 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 527/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:25 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:26.876699 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062bf521-3c6c-477f-9167-79e055bd0a8a"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:26.879352 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:26.885876 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:26.886346 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:26.886772 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:26.887453 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:26.887928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:26.888345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:26.919681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:26.920522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:26.927037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:26.927513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:26.927977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:26.928671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:26.929124 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:26.929556 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:27.065627 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:27.073984 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-55133ce1-393f-4b8d-9a66-75274974bae3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.158860 Aug 17 16:27:27.074480 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 528/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:26 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 16:27:27.265940 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-15393cd8-f501-4168-a1cd-467003b5ee5f tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "POST /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393019 Aug 17 16:27:27.266536 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 527/1055] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 17 16:27:26 2022] POST /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:28.094864 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:28.095468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:28.097425 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:28.098067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell0:SELECT=6 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:28.105232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:28.105705 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:28.106134 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:28.106814 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:28.107265 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:28.107680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:28.239751 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:28.247672 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-5119ce9b-7604-4873-bf8c-c50c64cda413 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.156928 Aug 17 16:27:28.248191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 529/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:28 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:29.266032 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell0:SELECT=2 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:29.270418 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:29.271120 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:29.277696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:29.278179 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:29.278617 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:29.279304 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:29.279756 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:29.280202 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:29.410780 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:29.419265 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a4b61725-8f97-4b32-862c-66ba9c0dcad0 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.154726 Aug 17 16:27:29.419846 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 528/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:29 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:30.441952 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:30.442559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:30.450246 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:30.450730 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:30.451158 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:30.451876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:30.452307 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:30.452716 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:30.583263 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:30.591019 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d0b9e77b-a8cb-472d-9a14-edcc0ea87a3a tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.152916 Aug 17 16:27:30.591596 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 530/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:30 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:31.289952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "name": "network-vif-plugged", "status": "completed", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:31.305355 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:31.305844 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:31.306284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:31.317696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] Creating event network-vif-plugged:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:27:31.322541 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-68f77324-cc0b-41e1-afc3-a433b0dd8f80 req-262296dc-abc1-4fc6-b8e8-6609f6a1d520 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092163 Aug 17 16:27:31.323119 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 529/1059] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:27:31.611931 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:31.612551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:31.619663 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:31.620174 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:31.620607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:31.621299 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:31.621753 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:31.622178 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:31.761522 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:31.770087 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6e2b0f1e-1dbf-4174-a496-aec6aa73dd81 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.162023 Aug 17 16:27:31.770671 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 531/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:31 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:32.796141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:32.796767 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:32.802970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:32.803443 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:32.803908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:32.804598 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:32.805050 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:32.805473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:32.945379 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:32.953112 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-d8173172-2c0a-40cc-8d47-0c8ddab56daf tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1259 microversion: 2.1 time: 0.161870 Aug 17 16:27:32.953667 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 530/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:32 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:33.974797 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:33.975353 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:33.982839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:33.983350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:33.983781 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:33.984496 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:33.984945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:33.985367 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:34.123977 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:34.131531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6f3558bb-86b4-4578-8828-62b0c0d73204 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1443 microversion: 2.1 time: 0.160666 Aug 17 16:27:34.132133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 532/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:33 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:34.153775 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:34.154851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:34.162527 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:34.163009 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:34.163440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:34.164180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:34.164721 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:34.165498 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:34.297583 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:34.305095 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-62f0db7d-9048-4544-94fd-3a88936cb9a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1443 microversion: 2.1 time: 0.156850 Aug 17 16:27:34.305659 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 531/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:34 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:34.918255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:34.919015 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:34.924930 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:34.925403 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:34.926059 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:34.926746 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:34.927191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:34.927610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:35.010254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lazy-loading 'services' on Instance uuid 9bb6dab6-9d40-4556-ae4d-92326671c2a8 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:27:35.083267 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-18951ebb-49be-400f-8e7b-d9d8eb079c13 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments/062bf521-3c6c-477f-9167-79e055bd0a8a" status: 202 len: 0 microversion: 2.1 time: 0.169219 Aug 17 16:27:35.084153 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 533/1064] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 17 16:27:34 2022] DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments/062bf521-3c6c-477f-9167-79e055bd0a8a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:27:35.093473 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:35.096142 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:35.102331 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:35.102850 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:35.104141 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:35.104891 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:35.105322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:35.105888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:35.145601 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-29d7dbca-bcc0-4f56-8b8d-06cf2484e8ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056414 Aug 17 16:27:35.146289 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 532/1065] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:27:35 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:36.159971 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:36.162191 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:36.168927 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.169405 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.169835 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.170523 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.170976 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.171398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.201303 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d25ff32b-e93c-451b-b771-7f730d32d64c tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046126 Aug 17 16:27:36.202056 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 534/1066] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 17 16:27:36 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 16:27:36.263998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:36.270885 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:36.271584 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:36.274975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.276016 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.276464 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.277532 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.278000 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.278427 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.279111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.279680 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.280754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.288469 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] Creating event network-changed:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:27:36.294311 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-1636305b-59e8-466f-9ad8-50b819e00019 req-ff0e53ec-b106-4464-af5f-12d80354674a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042970 Aug 17 16:27:36.295125 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 533/1067] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:36.312909 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Going to try to terminate instance {{(pid=120793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:27:36.406450 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f6a4cca9-e35c-4042-9be9-92b69c2793df tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 204 len: 0 microversion: 2.1 time: 0.139086 Aug 17 16:27:36.407270 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 535/1068] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:27:36 2022] DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 16:27:36.417640 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:36.418626 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:36.425252 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.425725 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.426153 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.426874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:36.427322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:36.427737 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:36.608393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:36.616025 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-dc4766f6-49a4-4824-bb3a-e96d80063642 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1681 microversion: 2.1 time: 0.203930 Aug 17 16:27:36.616634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 534/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:36 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:37.638720 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:37.639424 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:37.645951 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:37.646429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:37.646863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:37.647551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:37.648103 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:37.648479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:37.780252 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:37.787673 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-37acba17-5b0b-4a46-9bfe-b40c83dede98 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1681 microversion: 2.1 time: 0.153160 Aug 17 16:27:37.788282 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 536/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:37 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:38.809415 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:38.810101 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:38.816474 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:38.816953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:38.817384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:38.818249 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:38.818768 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:38.819188 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:39.104238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:39.111793 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e1830003-2fa6-44d3-9145-583337b00e45 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1681 microversion: 2.1 time: 0.306567 Aug 17 16:27:39.112399 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 535/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:38 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:39.958217 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb6dab6-9d40-4556-ae4d-92326671c2a8", "name": "network-vif-deleted", "tag": "bafefd86-a6ac-41cd-90ac-f1fec271685f"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:39.969840 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:39.970321 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:39.970757 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:39.983776 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] Creating event network-vif-deleted:bafefd86-a6ac-41cd-90ac-f1fec271685f for instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 on hv-cinder-85220 Aug 17 16:27:39.989645 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-b4207b41-35e7-400c-9cc1-565441d68130 req-de9bc044-15c2-484a-b031-3c2987a37339 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Aug 17 16:27:39.990692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 537/1072] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:40.132998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:40.133711 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:40.140558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:40.141123 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:40.141557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:40.142240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:40.142686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:40.143102 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:40.176059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:40.176543 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:40.176982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:40.177440 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.objects.instance [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lazy-loading 'fault' on Instance uuid 9bb6dab6-9d40-4556-ae4d-92326671c2a8 {{(pid=120794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:27:40.217958 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaa552d402646b28f2f52068558fce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0011ec6367f43859c048642b2c324a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:27:40.225731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-dfadfa0f-5d8a-4c4d-9c7c-49ce9c64a8de tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 200 len: 1331 microversion: 2.1 time: 0.096634 Aug 17 16:27:40.226317 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 536/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:40 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:27:41.248090 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:41.248795 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:41.255526 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:41.256039 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:41.256498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:41.257187 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:41.257641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:41.258064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:41.262693 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:41.272718 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 HTTP/1.1 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:41.274329 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:41.276660 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '9bb6dab6-9d40-4556-ae4d-92326671c2a8'} Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:41.277547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:41.279096 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:41.280484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:41.280484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c8b98a18-8379-4e9a-aedc-c3f68e5fc9c4 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 404 len: 111 microversion: 2.1 time: 0.032298 Aug 17 16:27:41.280484 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 538/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:41 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:41.285673 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5bb06da8-f53c-4053-95b8-d71194a89546 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '.version_select at 0x7f9eea4561f0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:41.303442 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5bb06da8-f53c-4053-95b8-d71194a89546 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473856085" status: 202 len: 0 microversion: 2.1 time: 0.021625 Aug 17 16:27:41.304022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 537/1075] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 17 16:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473856085 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:27:43.039607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:43.040114 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:43.048531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:43.049005 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:43.049432 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:43.050108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:43.050550 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:43.050967 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:43.065274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 HTTP/1.1 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:43.066788 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.068519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '9bb6dab6-9d40-4556-ae4d-92326671c2a8'} Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:43.069607 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.071060 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.072926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:43.072926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-76e96dc8-2ede-443a-9398-bf6ff5f46288 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 404 len: 111 microversion: 2.1 time: 0.032332 Aug 17 16:27:43.072926 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 539/1076] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:27:43 2022] DELETE /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:43.077325 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:43.077935 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: 9bb6dab6-9d40-4556-ae4d-92326671c2a8] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:43.086533 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:43.087005 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:43.087503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:43.088726 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:43.089373 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:43.089745 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:43.102945 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 HTTP/1.1 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:43.105432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.107036 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '9bb6dab6-9d40-4556-ae4d-92326671c2a8'} Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:43.108042 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. Aug 17 16:27:43.109518 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:43.110974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance 9bb6dab6-9d40-4556-ae4d-92326671c2a8 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:43.110974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b56c0e21-0b45-4edf-9f9c-c81c03e787ab tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8" status: 404 len: 111 microversion: 2.1 time: 0.033817 Aug 17 16:27:43.110974 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 538/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:43 2022] GET /compute/v2.1/servers/9bb6dab6-9d40-4556-ae4d-92326671c2a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:27:44.248492 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:44.248995 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:44.255465 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.255963 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.256402 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.257108 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.257549 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.258008 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.272381 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 HTTP/1.1 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:44.273899 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.275588 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'd2a1e7ec-56b5-49ca-97e0-c2e9e8e11536'} Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:44.276577 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.278029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.279528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:44.279528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-02ce48e6-0cd2-4958-a243-2a8873061332 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 404 len: 111 microversion: 2.1 time: 0.030609 Aug 17 16:27:44.279528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 540/1078] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:27:44 2022] DELETE /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:44.283995 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:44.284608 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:44.291557 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.292061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.292492 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.293166 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.293612 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.294026 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.307760 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 HTTP/1.1 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:44.309274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.310872 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'd2a1e7ec-56b5-49ca-97e0-c2e9e8e11536'} Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:44.311732 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. Aug 17 16:27:44.313078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.314208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:44.314208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-eab99676-6263-462f-92f8-caae765f1e8b tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536" status: 404 len: 111 microversion: 2.1 time: 0.030795 Aug 17 16:27:44.314208 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 539/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:44 2022] GET /compute/v2.1/servers/d2a1e7ec-56b5-49ca-97e0-c2e9e8e11536 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:44.319232 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:44.319733 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:44.325916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.326400 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.326837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.327529 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.328026 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.328455 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.341833 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 HTTP/1.1 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:44.343388 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.345284 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5'} Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:44.346315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.347826 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.349438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:44.349438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-6cbe98a9-d91b-420e-9b67-f8e6dae0f8cf tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 404 len: 111 microversion: 2.1 time: 0.029450 Aug 17 16:27:44.349438 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 541/1080] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:27:44 2022] DELETE /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:27:44.353875 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:44.354643 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:44.360754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.361242 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.361677 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.362367 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:44.362820 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:44.363270 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:44.377250 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 HTTP/1.1 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:44.378754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.380466 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5'} Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:44.381566 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. Aug 17 16:27:44.383217 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:44.385370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:44.385370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-c6d3a571-c3fd-4793-910c-af8bc9578525 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5" status: 404 len: 111 microversion: 2.1 time: 0.030643 Aug 17 16:27:44.385370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 540/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:44 2022] GET /compute/v2.1/servers/ad24d894-97c4-41cc-8f8d-ebbf1fb6aac5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:27:45.517786 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:45.518290 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:45.524578 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:45.525068 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:45.525739 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:45.526422 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:45.526869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:45.527283 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:45.540648 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 HTTP/1.1 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:45.542459 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: > Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.544077 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': 'e6cbbfc2-960e-4958-b35b-1f290e5e9353'} Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:45.545181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.546701 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.548325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:45.548325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-669ec7a1-a7aa-4d5e-860b-54a19c8113f7 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 404 len: 111 microversion: 2.1 time: 0.029871 Aug 17 16:27:45.548325 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 542/1082] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:27:45 2022] DELETE /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:45.552129 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:45.552747 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] [instance: e6cbbfc2-960e-4958-b35b-1f290e5e9353] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:27:45.559857 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:45.560348 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:45.560784 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:45.562441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:27:45.562899 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:27:45.563326 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:27:45.577467 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] HTTP exception thrown: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Request method failure captured: Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 HTTP/1.1 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RX5F-90ebSW0BHozKf8PojoSxIbOga3TrpgkDrQAvCiWoeFjkPSgfC1lJc566QTVQRAV-Xfn0Oh1EvvXPlZZio3XIAjIlEdlM1uWO3jse3Rg0PMImirgJAUs7DgLdo4uLifrKLgXh9udDcN3FJOKhqaM1SDCogqCQRENzG0bgkjb-o Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:45.578970 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c0011ec6367f43859c048642b2c324a1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c0011ec6367f43859c048642b2c324a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: c0011ec6367f43859c048642b2c324a1 Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131432048 Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: efaa552d402646b28f2f52068558fce0 Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-AttachVolumeNegativeTest-2131432048-project Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.580579 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': 'e6cbbfc2-960e-4958-b35b-1f290e5e9353'} Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:45.581490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. Aug 17 16:27:45.582936 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:45.584182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] Returning 404 to user: Instance e6cbbfc2-960e-4958-b35b-1f290e5e9353 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:45.584182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-6bc234da-7007-44f5-8625-c5b985f81397 tempest-AttachVolumeNegativeTest-2131432048 tempest-AttachVolumeNegativeTest-2131432048-project] 10.222.0.60 "GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353" status: 404 len: 111 microversion: 2.1 time: 0.032084 Aug 17 16:27:45.584182 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 541/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:27:45 2022] GET /compute/v2.1/servers/e6cbbfc2-960e-4958-b35b-1f290e5e9353 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:49.867939 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-cf1db891-62da-424b-aca6-2201da096b6b tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Action: 'create', calling method: .version_select at 0x7f9eeebfa4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1002336834"}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:50.153780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-cf1db891-62da-424b-aca6-2201da096b6b tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.406430 Aug 17 16:27:50.154468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 543/1084] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Aug 17 16:27:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 16:27:50.167448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0305ee24-87f4-4053-abe6-3d6f22849769 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eeae38a60>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:50.219060 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0305ee24-87f4-4053-abe6-3d6f22849769 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 200 len: 345 microversion: 2.1 time: 0.056288 Aug 17 16:27:50.219999 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 542/1085] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:27:50 2022] GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:51.234429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-91a01c0b-a47b-492e-99f8-5096cc9b1e6e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea359af0>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:51.281012 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-91a01c0b-a47b-492e-99f8-5096cc9b1e6e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 200 len: 346 microversion: 2.1 time: 0.050888 Aug 17 16:27:51.281569 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 544/1086] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:27:51 2022] GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:27:51.295019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-271c0b7f-5b65-467d-95a8-688afee387d2 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Action: 'create', calling method: .version_select at 0x7f9eea1563a0>, body: {"snapshot": {"volume_id": "03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-678367422"}} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:27:51.456343 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-271c0b7f-5b65-467d-95a8-688afee387d2 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.166242 Aug 17 16:27:51.456927 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 543/1087] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Aug 17 16:27:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:51.468171 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-d92d4432-cdf5-4a72-a734-241476fdd845 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea623f70>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:51.499870 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-d92d4432-cdf5-4a72-a734-241476fdd845 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 286 microversion: 2.1 time: 0.035397 Aug 17 16:27:51.500567 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 545/1088] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:51 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:27:51.512358 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-0de87ac3-1d59-4f7e-af7a-70e9caccb9f0 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea391c10>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:51.543432 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-0de87ac3-1d59-4f7e-af7a-70e9caccb9f0 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035064 Aug 17 16:27:51.544022 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 544/1089] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 17 16:27:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:51.554681 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fcc3ca83-504d-42a5-a0ca-d67d1aaab1df tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea2ab280>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:51.583721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fcc3ca83-504d-42a5-a0ca-d67d1aaab1df tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 286 microversion: 2.1 time: 0.032711 Aug 17 16:27:51.584289 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 546/1090] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:51 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:52.597289 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ffe17cbe-5d12-4427-9e1c-0f7acdfe27f8 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eeae38160>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:52.627463 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ffe17cbe-5d12-4427-9e1c-0f7acdfe27f8 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 286 microversion: 2.1 time: 0.034672 Aug 17 16:27:52.628049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 545/1091] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:52 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:53.641091 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-aa89c074-875a-4bac-aa72-98a197dc8ecc tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea344e50>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:53.671844 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-aa89c074-875a-4bac-aa72-98a197dc8ecc tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 286 microversion: 2.1 time: 0.034971 Aug 17 16:27:53.672401 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 547/1092] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:53 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:54.684448 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-4b75ca48-b50b-497e-8b91-09235fa0b560 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea384a60>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:54.714256 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-4b75ca48-b50b-497e-8b91-09235fa0b560 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 287 microversion: 2.1 time: 0.034186 Aug 17 16:27:54.714808 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 546/1093] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:54 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:54.726247 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-529241a3-d65e-4eaa-a59c-8b8053809310 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea2b5160>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:54.784417 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-529241a3-d65e-4eaa-a59c-8b8053809310 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 202 len: 0 microversion: 2.1 time: 0.062354 Aug 17 16:27:54.784988 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 548/1094] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Aug 17 16:27:54 2022] DELETE /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:27:54.793375 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e90e9be4-e570-4d14-8e3e-446dc39d252f tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea2864c0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:54.823425 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e90e9be4-e570-4d14-8e3e-446dc39d252f tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 200 len: 286 microversion: 2.1 time: 0.034206 Aug 17 16:27:54.824043 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 547/1095] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:54 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:55.832857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:55.833598 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=8 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:55.838156 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b2e661ba-ca03-4d3c-8280-c51f267ed102 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea2a6790>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:55.864097 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-b2e661ba-ca03-4d3c-8280-c51f267ed102 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] HTTP exception thrown: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b2e661ba-ca03-4d3c-8280-c51f267ed102 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Request method failure captured: Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 HTTP/1.1 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RcF6m-JSYwjfvnyJGIRiJSv6BN3hugmTMxjoWvQTlCspnoE7JictokbfdSMk6SwkCRAApzW9X6lGVy8fjVBQsLRMhlyckiOVzcIvniXzNoCCHY6ApxQ8kleVlcG9A0XCC8Al88VNVodkrkMiw9efBICsZA15nxLR8urIiIHw7PL_kQ Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:55.866768 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9464184bc45e4c48891f1e02bf7a3686", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 56bed200030542359dd0bcad9695d3b8 Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '43f34500-dd9d-4743-81b5-56042fa134d8'} Aug 17 16:27:55.868179 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. (HTTP 404) (Request-ID: req-e4452487-2cd4-425b-8308-36f31e9fa5e7) Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.869837 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:55.871320 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 16:27:55.873165 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b2e661ba-ca03-4d3c-8280-c51f267ed102 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Returning 404 to user: Snapshot 43f34500-dd9d-4743-81b5-56042fa134d8 could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:55.874629 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b2e661ba-ca03-4d3c-8280-c51f267ed102 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8" status: 404 len: 111 microversion: 2.1 time: 0.036126 Aug 17 16:27:55.876454 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 549/1096] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 17 16:27:55 2022] GET /compute/v2.1/os-snapshots/43f34500-dd9d-4743-81b5-56042fa134d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:55.876562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:55.876562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:55.880581 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-df5f36d6-6ec5-4ce0-b504-da51efeefca3 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea456430>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:55.941237 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-df5f36d6-6ec5-4ce0-b504-da51efeefca3 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 202 len: 0 microversion: 2.1 time: 0.067212 Aug 17 16:27:55.942007 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 548/1097] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:27:55 2022] DELETE /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:27:55.950453 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-b03a634e-b670-497c-977f-21fcec3dadfc tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea2ab670>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:55.999254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-b03a634e-b670-497c-977f-21fcec3dadfc tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 200 len: 345 microversion: 2.1 time: 0.052973 Aug 17 16:27:55.999892 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 550/1098] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:27:55 2022] GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:27:57.013897 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e225f0b9-bed9-4412-8669-a5ca6dcbbd2e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea1d9550>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:57.041585 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-e225f0b9-bed9-4412-8669-a5ca6dcbbd2e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] HTTP exception thrown: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e225f0b9-bed9-4412-8669-a5ca6dcbbd2e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Request method failure captured: Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f HTTP/1.1 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RcF6m-JSYwjfvnyJGIRiJSv6BN3hugmTMxjoWvQTlCspnoE7JictokbfdSMk6SwkCRAApzW9X6lGVy8fjVBQsLRMhlyckiOVzcIvniXzNoCCHY6ApxQ8kleVlcG9A0XCC8Al88VNVodkrkMiw9efBICsZA15nxLR8urIiIHw7PL_kQ Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:57.043621 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9464184bc45e4c48891f1e02bf7a3686", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 56bed200030542359dd0bcad9695d3b8 Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f'} Aug 17 16:27:57.045174 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. (HTTP 404) (Request-ID: req-135ff089-f82a-477c-bf2b-932a3476f658) Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.046059 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:57.047284 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 16:27:57.048504 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e225f0b9-bed9-4412-8669-a5ca6dcbbd2e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Returning 404 to user: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e225f0b9-bed9-4412-8669-a5ca6dcbbd2e tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 404 len: 109 microversion: 2.1 time: 0.035737 Aug 17 16:27:57.049783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 549/1099] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:27:57 2022] GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:27:57.060377 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f386d16a-0bf7-4ff7-93de-ca45c4168582 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea359280>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:57.087133 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.wsgi [None req-f386d16a-0bf7-4ff7-93de-ca45c4168582 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] HTTP exception thrown: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f386d16a-0bf7-4ff7-93de-ca45c4168582 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Request method failure captured: Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: request: DELETE /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f HTTP/1.1 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept: application/json Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Accept-Encoding: identity Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Connection: close Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Length: 0 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Content-Type: application/json Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Host: 10.222.0.60 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Openstack-System-Scope: None Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Auth-Token: gAAAAABi_RcF6m-JSYwjfvnyJGIRiJSv6BN3hugmTMxjoWvQTlCspnoE7JictokbfdSMk6SwkCRAApzW9X6lGVy8fjVBQsLRMhlyckiOVzcIvniXzNoCCHY6ApxQ8kleVlcG9A0XCC8Al88VNVodkrkMiw9efBICsZA15nxLR8urIiIHw7PL_kQ Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Id: None Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Domain-Name: None Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Identity-Status: Confirmed Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Is-Admin-Project: True Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Id: default Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Domain-Name: Default Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Role: member,reader Aug 17 16:27:57.089834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Roles: member,reader Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9464184bc45e4c48891f1e02bf7a3686", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Id: default Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Domain-Name: Default Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Id: 56bed200030542359dd0bcad9695d3b8 Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: method: Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: exception: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: action_args: {'id': '03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f'} Aug 17 16:27:57.091445 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. (HTTP 404) (Request-ID: req-2912bd1b-7d4b-4005-ab01-ec9eb190f021) Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.092473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 16:27:57.093917 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 16:27:57.095587 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f386d16a-0bf7-4ff7-93de-ca45c4168582 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Returning 404 to user: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. {{(pid=120793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f386d16a-0bf7-4ff7-93de-ca45c4168582 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 404 len: 109 microversion: 2.1 time: 0.036043 Aug 17 16:27:57.097037 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 551/1100] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 17 16:27:57 2022] DELETE /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 16:27:57.100012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5b32dcbb-57a3-41b3-9dcb-5f63069c1a42 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Calling method '.version_select at 0x7f9eea456ee0>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:27:57.131154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-5b32dcbb-57a3-41b3-9dcb-5f63069c1a42 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] HTTP exception thrown: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5b32dcbb-57a3-41b3-9dcb-5f63069c1a42 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Request method failure captured: Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f HTTP/1.1 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RcF6m-JSYwjfvnyJGIRiJSv6BN3hugmTMxjoWvQTlCspnoE7JictokbfdSMk6SwkCRAApzW9X6lGVy8fjVBQsLRMhlyckiOVzcIvniXzNoCCHY6ApxQ8kleVlcG9A0XCC8Al88VNVodkrkMiw9efBICsZA15nxLR8urIiIHw7PL_kQ Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:27:57.133449 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9464184bc45e4c48891f1e02bf7a3686", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9464184bc45e4c48891f1e02bf7a3686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 9464184bc45e4c48891f1e02bf7a3686 Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-602368614 Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: 56bed200030542359dd0bcad9695d3b8 Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-602368614-project Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f'} Aug 17 16:27:57.135180 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. (HTTP 404) (Request-ID: req-ae2d64d7-2cf7-416f-8510-6fe7bef0e6e6) Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.136189 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 16:27:57.137605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 16:27:57.139089 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5b32dcbb-57a3-41b3-9dcb-5f63069c1a42 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] Returning 404 to user: Volume 03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5b32dcbb-57a3-41b3-9dcb-5f63069c1a42 tempest-VolumesSnapshotsTestJSON-602368614 tempest-VolumesSnapshotsTestJSON-602368614-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f" status: 404 len: 109 microversion: 2.1 time: 0.038924 Aug 17 16:27:57.140623 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 550/1101] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 17 16:27:57 2022] GET /compute/v2.1/os-volumes/03f0b5f6-6b2c-4560-9c1a-4a00fab19b8f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:28:57.403982 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:28:57.404605 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Wed Aug 17 16:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:29:33.736721 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:29:33.737301 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:33.746908 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:33.747397 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:33.747853 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:33.748565 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:33.749017 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:33.749437 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:33.773726 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lazy-loading 'flavor' on Instance uuid 9120f4e8-b534-49fa-a47e-4ecf0634eff3 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:29:33.847631 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c79ae1ce-b270-4362-870d-3b2369a4df1d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "POST /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3/action" status: 202 len: 0 microversion: 2.1 time: 0.116766 Aug 17 16:29:33.848292 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 552/1102] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:29:33 2022] POST /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:29:33.855126 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d4690770-58d3-43e3-8222-823cffdd8d0f] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 16:29:33.859164 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:33.859781 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:33.865877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:33.866476 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:33.867121 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:33.867854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:33.868336 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:33.868742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:34.030874 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:34.039214 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9d10a86b-7cf5-499e-84b3-2409168b6158 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.186590 Aug 17 16:29:34.039787 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 551/1103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:33 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:35.062921 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:35.063647 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:35.069834 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:35.070315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:35.070751 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:35.071436 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:35.071912 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:35.072334 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:35.206698 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:35.215315 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-49609be1-decf-4951-a1f1-4f07429e0b4f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.157066 Aug 17 16:29:35.215911 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 553/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:35 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:36.236709 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:36.237322 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:36.245403 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:36.245888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:36.246327 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:36.247019 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:36.247472 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:36.247926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:36.264147 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] [d4690770-58d3-43e3-8222-823cffdd8d0f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36202. Aug 17 16:29:36.381486 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:36.389742 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-07334d62-45e8-4cca-916c-de4028f7e2a6 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.156833 Aug 17 16:29:36.390314 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 552/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:36 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:37.411348 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:37.411995 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:37.419308 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:37.419780 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:37.420231 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:37.420910 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:37.421373 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:37.421770 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:37.554905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:37.562575 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2106f0b5-c4a8-4f87-91e0-95f29f426ad4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.155111 Aug 17 16:29:37.563139 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 554/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:37 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:38.583312 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:38.583952 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:38.591307 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:38.591783 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:38.592236 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:38.592926 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:38.593381 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:38.593807 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:38.725321 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:38.733908 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-185c4068-d556-4ce6-959c-737934b0406f tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.154436 Aug 17 16:29:38.734470 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 553/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:38 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:39.755539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:39.756194 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:39.762985 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:39.763466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:39.763924 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:39.764610 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:39.765057 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:39.765473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:39.897539 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:39.905200 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-f02b4f90-8f02-49e1-b656-67b7023d5e7d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.153515 Aug 17 16:29:39.905758 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 555/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:39 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:40.926165 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:40.926774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:40.934342 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:40.934814 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:40.935240 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:40.935972 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:40.936421 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:40.937138 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:41.070977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:41.078964 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-907b75e4-ed5f-4f7e-a429-ae6b438709ba tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.156705 Aug 17 16:29:41.079528 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 554/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:40 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:42.100515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:42.101041 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:42.108552 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:42.109029 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:42.109466 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:42.110152 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:42.110603 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:42.111023 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:42.241266 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:42.249111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-e9f48f49-d239-4998-b262-ea577c4b8aeb tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.152497 Aug 17 16:29:42.249945 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 556/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:42 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:43.271349 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:43.271998 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:43.278888 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:43.279366 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:43.279819 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:43.280513 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:43.280969 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:43.281393 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:43.411389 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:43.419746 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-898b83a8-084c-4f94-ab29-277caf1d0089 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.152289 Aug 17 16:29:43.420333 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 555/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:43 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:44.440559 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:44.441172 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:44.447677 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:44.448863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:44.449296 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:44.449987 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:44.450446 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:44.450869 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:44.582916 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:44.591273 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-c7b27fc0-acea-46ec-884a-a031395d1a60 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.154491 Aug 17 16:29:44.591857 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 557/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:44 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:45.612622 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:45.613216 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:45.619774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:45.620977 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:45.621444 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:45.622130 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:45.622593 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:45.623084 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:45.754154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:45.762061 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ce48e666-5132-4d0f-b5ee-82cc7dd4b0fe tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.153275 Aug 17 16:29:45.762619 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 556/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:45 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:46.783411 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:46.783960 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:46.790350 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:46.790825 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:46.791274 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:46.792036 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:46.792528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:46.792944 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:46.922838 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:46.931349 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-fc93cc97-c311-49e0-a78c-cf040ca61853 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.151917 Aug 17 16:29:46.931937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 558/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:46 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:47.951634 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:47.952274 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:47.958774 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:47.959255 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:47.959754 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:47.960519 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:47.960925 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:47.961337 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:48.098176 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:48.106740 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-a1dec153-acfb-4fad-a4cd-ea8e4e4e6e3e tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1569 microversion: 2.1 time: 0.159045 Aug 17 16:29:48.107305 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 557/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:47 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:48.127064 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:29:48.127658 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:48.133997 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:48.134476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:48.134905 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:48.135710 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:48.136345 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:48.136769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:48.179089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120793) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 16:29:48.246913 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-2112d711-5b01-4d7b-a31c-ff36d3fb0d78 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "POST /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3/action" status: 202 len: 0 microversion: 2.1 time: 0.123722 Aug 17 16:29:48.247845 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 559/1116] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 17 16:29:48 2022] POST /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:29:48.255596 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:48.256229 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:48.263081 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:48.263563 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:48.264012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:48.264707 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:48.265154 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:48.265570 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:48.404065 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:48.411686 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-ea8670da-445c-4e76-8e65-a9455b8a6a3b tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1517 microversion: 2.1 time: 0.159929 Aug 17 16:29:48.412276 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 558/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:48 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:49.434451 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:49.435027 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:49.441004 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:49.441486 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:49.441946 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:49.442635 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:49.443089 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:49.443538 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:49.582421 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:49.590146 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-665f156d-43db-4625-97fc-5af14ad3c903 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1519 microversion: 2.1 time: 0.160877 Aug 17 16:29:49.590959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 560/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:49 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:50.612368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:50.613113 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:50.619169 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:50.619641 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:50.620757 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:50.621441 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:50.621890 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:50.622310 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:50.839384 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:50.847244 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-9ce5e56c-b7f2-41e4-a8ff-4ebbf3b6c2a2 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.238690 Aug 17 16:29:50.847831 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 559/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:50 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:51.868541 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:51.869141 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:51.875609 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:51.876123 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:51.876561 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:51.877240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:51.877692 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:51.878115 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:51.914933 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "name": "network-vif-unplugged", "status": "completed", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:29:51.925684 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:51.926161 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:51.926589 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:51.939881 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] Creating event network-vif-unplugged:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:29:51.943408 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR oslo.messaging._drivers.impl_rabbit [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] [ca09b9d7-530c-4dc7-abea-34b95381c3bd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 16:29:52.015667 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:52.023513 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-05a7425c-2bf3-4102-b444-ddbdc951a87c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.158911 Aug 17 16:29:52.024125 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 561/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:51 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:52.953012 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] [ca09b9d7-530c-4dc7-abea-34b95381c3bd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36254. Aug 17 16:29:52.957676 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-f7413fe8-f629-4eb1-b7b9-ef7740c0ff4d req-163cf946-b94f-414f-962c-592da89d7e3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.046505 Aug 17 16:29:52.958278 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 560/1121] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:29:53.043876 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:53.044481 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:53.050994 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:53.051468 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:53.051937 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:53.052620 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:53.053070 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:53.053491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:53.188873 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:53.196429 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-bfc28f3d-2fca-45c4-9fc3-28abb0e41b84 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.156698 Aug 17 16:29:53.196996 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 562/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:53 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:54.219254 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:54.220263 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:54.226397 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:54.226879 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:54.227315 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:54.228037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:54.228496 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:54.228919 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:54.362111 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:54.369615 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-dc915041-0a72-41b9-b4af-d115dce3eb54 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.155123 Aug 17 16:29:54.370303 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 561/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:54 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:55.391264 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:55.392022 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:55.398491 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:55.398959 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:55.399385 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:55.400088 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:55.400536 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:55.401626 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:55.534143 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:55.541528 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-a09bf09e-727b-4919-b30d-4e1a66375a6d tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.154096 Aug 17 16:29:55.542161 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 563/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:55 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:56.563738 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:56.564370 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:56.570851 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:56.571324 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:56.571752 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:56.572465 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:56.575266 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:56.575705 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:56.709460 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:56.716928 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b2663d7e-1ec5-47de-baa9-b8bab43c40da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.156998 Aug 17 16:29:56.717490 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 562/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:56 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:57.738515 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:57.739067 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:57.746258 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:57.746767 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:57.747192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:57.747900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:57.748354 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:57.748775 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:57.882310 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:57.890192 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-47354349-aed6-4dab-b920-e26f220df787 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1575 microversion: 2.1 time: 0.155615 Aug 17 16:29:57.890965 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 564/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:57 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:29:58.911864 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:29:58.912480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:29:58.919074 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:58.919558 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:58.920037 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:58.920724 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:29:58.921179 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:29:58.921605 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:29:59.051965 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:29:59.059629 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-e3325bad-2519-41c9-8ddd-8beda6fbb3d4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1562 microversion: 2.1 time: 0.151715 Aug 17 16:29:59.060223 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 563/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:29:58 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:30:00.222754 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "name": "network-vif-plugged", "status": "completed", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:30:00.232728 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:30:00.233210 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:30:00.233641 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:30:00.245883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] Creating event network-vif-plugged:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:30:00.250889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-0f02b276-8581-40a4-b2bb-f3c347d71511 req-c9723842-159a-40f5-ba70-b99286f6964f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Aug 17 16:30:00.251473 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 565/1128] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:30:36.669975 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:30:36.670607 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Wed Aug 17 16:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:30:41.753426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:30:41.754049 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Wed Aug 17 16:30:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:31:15.479362 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_api:SELECT=26 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.480427 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG dbcounter [-] [120794] Writing DB stats nova_cell1:SELECT=74 {{(pid=120794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.482821 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.484135 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG dbcounter [-] [120793] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.485158 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:15.485698 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:15.496447 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:15.496982 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:15.497368 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:15.498144 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:15.498620 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:15.499114 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:15.528345 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Going to try to terminate instance {{(pid=120794) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 16:31:15.553897 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:31:15.564021 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:15.564494 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:15.565268 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:15.577531 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.compute.server_external_events [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] Creating event network-changed:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:31:15.583111 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [req-cc4c3dc0-272b-4c00-827b-74e65e90125c req-9fc29c91-af45-4864-9a2a-39e39622b02a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102571 Aug 17 16:31:15.583784 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 566/1129] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 16:31:15.628778 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-5e6a8786-0528-4b3f-9aa3-6c5abaa198da tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 204 len: 0 microversion: 2.1 time: 0.150213 Aug 17 16:31:15.632417 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 564/1130] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 17 16:31:15 2022] DELETE /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 16:31:15.638883 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:15.639748 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:15.646255 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:15.646922 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:15.647395 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:15.648336 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:15.648889 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:15.649237 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:15.845479 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:31:15.853201 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-0a4ea402-bb88-4d9d-b20f-ad98cc6918bd tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.219072 Aug 17 16:31:15.854078 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 567/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:31:15 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:31:16.875696 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:16.876426 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:16.882828 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:16.883303 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:16.883731 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:16.884434 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:16.884877 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:16.885293 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:17.141078 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.policy [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120794) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:31:17.148903 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b0081d9b-cdd4-4423-b72f-ce6afe62e3f4 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1568 microversion: 2.1 time: 0.277188 Aug 17 16:31:17.149923 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 565/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:31:16 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:31:18.171704 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:18.172343 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:18.178752 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:18.179254 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:18.179683 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:18.180398 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:18.180842 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:18.181259 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:18.321863 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:31:18.330476 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8c9b2e5e-ce1b-47bb-9475-c44ff7f41790 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1449 microversion: 2.1 time: 0.163794 Aug 17 16:31:18.344900 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 568/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:31:18 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:31:18.435410 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9120f4e8-b534-49fa-a47e-4ecf0634eff3", "name": "network-vif-deleted", "tag": "a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7"}]} {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 16:31:18.445443 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:18.445913 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:18.446332 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:18.458388 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.compute.server_external_events [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] Creating event network-vif-deleted:a6ac1ee1-9bc5-462a-8d5e-12772b8e79d7 for instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 on hv-cinder-85220 Aug 17 16:31:18.463168 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [req-c6c1f1bf-99c4-4a49-a139-1dc9ef40cfe6 req-1c37122f-854c-49e2-9d5e-227820100894 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Aug 17 16:31:18.464537 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 566/1134] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 17 16:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 16:31:19.352211 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:19.352817 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.compute.api [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:19.359547 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:19.360066 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:19.360498 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:19.361183 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:19.361662 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:19.362086 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:19.395555 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:19.396085 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:19.396519 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG oslo_concurrency.lockutils [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:19.396957 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.objects.instance [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lazy-loading 'fault' on Instance uuid 9120f4e8-b534-49fa-a47e-4ecf0634eff3 {{(pid=120793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 16:31:19.439240 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.policy [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4405fb9580444eda2c63017ebc41d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035e36bbf4bc4c6384765fde5bde5b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 16:31:19.446839 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-4688fd7a-775b-4cf7-95fe-9fd180b3b9a3 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 200 len: 1224 microversion: 2.1 time: 0.098480 Aug 17 16:31:19.447769 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 569/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:31:19 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 16:31:20.471512 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '>' {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:20.472232 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.compute.api [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] [instance: 9120f4e8-b534-49fa-a47e-4ecf0634eff3] Fetching instance by UUID {{(pid=120794) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 16:31:20.478531 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:20.479013 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:20.479480 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:20.480765 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Acquiring lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 16:31:20.481238 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 16:31:20.481660 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG oslo_concurrency.lockutils [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Lock "37367ca3-7f41-4991-90e4-8af97b9dc4a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 16:31:20.494843 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.wsgi [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] HTTP exception thrown: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Request method failure captured: Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: request: GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 HTTP/1.1 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept: application/json Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Accept-Encoding: identity Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Connection: close Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Length: 0 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Content-Type: application/json Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Host: 10.222.0.60 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Openstack-System-Scope: None Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: User-Agent: python-urllib3/1.26.11 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Auth-Token: gAAAAABi_RbOrADAu_2T4k2wtOgruz3bqcNbNFemsuxbZztvDzEzR0SoaDe4pSY9tOh9PXKSlMXVpTh7Xl5aS9X4Mo04CtiE9mBKR4CaGQn3opmwk6MUrbVQ0Zoc0wmcs7mkh6raRsqb9g2sC7-C-TP8i9wban3mxsWfrgVsrtZLiGng56wfAZo Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Id: None Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Domain-Name: None Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Identity-Status: Confirmed Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Is-Admin-Project: True Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Id: default Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Domain-Name: Default Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Id: 035e36bbf4bc4c6384765fde5bde5b26 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Project-Name: tempest-TestShelveInstance-569852750 Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Role: member,reader Aug 17 16:31:20.497204 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Roles: member,reader Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/035e36bbf4bc4c6384765fde5bde5b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/035e36bbf4bc4c6384765fde5bde5b26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_035e36bbf4bc4c6384765fde5bde5b26", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/035e36bbf4bc4c6384765fde5bde5b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant: tempest-TestShelveInstance-569852750 Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Id: 035e36bbf4bc4c6384765fde5bde5b26 Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-Tenant-Name: tempest-TestShelveInstance-569852750 Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User: tempest-TestShelveInstance-569852750-project Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Id: default Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Domain-Name: Default Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Id: a4405fb9580444eda2c63017ebc41d78 Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: X-User-Name: tempest-TestShelveInstance-569852750-project Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: method: > Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: exception: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. Aug 17 16:31:20.499063 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: action_args: {'id': '9120f4e8-b534-49fa-a47e-4ecf0634eff3'} Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: {{(pid=120794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 16:31:20.500073 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. Aug 17 16:31:20.501562 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: ERROR nova.api.openstack.wsgi Aug 17 16:31:20.502854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: DEBUG nova.api.openstack.wsgi [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Returning 404 to user: Instance 9120f4e8-b534-49fa-a47e-4ecf0634eff3 could not be found. {{(pid=120794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 16:31:20.502854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO nova.api.openstack.requestlog [None req-b94725cf-ced3-4c71-83fe-f115fca4a835 tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3" status: 404 len: 111 microversion: 2.1 time: 0.031955 Aug 17 16:31:20.502854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: [pid: 120794|app: 0|req: 567/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 17 16:31:20 2022] GET /compute/v2.1/servers/9120f4e8-b534-49fa-a47e-4ecf0634eff3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:20.660219 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: DEBUG nova.api.openstack.wsgi [None req-8255e1f6-e3da-4323-86e8-20ae410d596c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] Calling method '.version_select at 0x7f9eeeb2e160>' {{(pid=120793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 16:31:20.682558 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO nova.api.openstack.requestlog [None req-8255e1f6-e3da-4323-86e8-20ae410d596c tempest-TestShelveInstance-569852750 tempest-TestShelveInstance-569852750-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1084596684" status: 202 len: 0 microversion: 2.1 time: 0.026066 Aug 17 16:31:20.683551 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: [pid: 120793|app: 0|req: 570/1137] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Aug 17 16:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1084596684 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 16:33:56.678392 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:33:56.678854 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Wed Aug 17 16:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:33:57.414456 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:33:57.415047 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Wed Aug 17 16:33:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:34:01.761953 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:34:01.762503 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Wed Aug 17 16:34:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:34:10.978524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:34:10.978524 dv-cinder-852208-6-iscsi devstack@n-api.service[120794]: Wed Aug 17 16:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:34:21.004181 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:34:21.004697 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Wed Aug 17 16:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 16:35:42.174774 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 16:35:42.175501 dv-cinder-852208-6-iscsi devstack@n-api.service[120793]: Wed Aug 17 16:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!